-- Logs begin at Thu 2022-09-08 00:33:36 UTC, end at Thu 2022-09-08 01:31:54 UTC. -- Sep 08 00:58:48.650573 dv-cinder-847733-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 08 00:58:48.659067 dv-cinder-847733-3-smb devstack@keystone.service[81661]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 00:58:48 2022] *** Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: nodename: dv-cinder-847733-3-smb Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: machine: x86_64 Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: clock source: unix Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: pcre jit disabled Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: detected number of CPU cores: 4 Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: current working directory: / Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: detected binary path: /usr/bin/uwsgi-core Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: your processes number limit is 47680 Sep 08 00:58:48.661076 dv-cinder-847733-3-smb devstack@keystone.service[81661]: your memory page size is 4096 bytes Sep 08 00:58:48.661889 dv-cinder-847733-3-smb devstack@keystone.service[81661]: detected max file descriptor number: 2048 Sep 08 00:58:48.661889 dv-cinder-847733-3-smb devstack@keystone.service[81661]: lock engine: pthread robust mutexes Sep 08 00:58:48.661889 dv-cinder-847733-3-smb devstack@keystone.service[81661]: thunder lock: enabled Sep 08 00:58:48.661889 dv-cinder-847733-3-smb devstack@keystone.service[81661]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 08 00:58:48.661889 dv-cinder-847733-3-smb devstack@keystone.service[81661]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 00:58:48.700585 dv-cinder-847733-3-smb devstack@keystone.service[81661]: Python main interpreter initialized at 0x558d7f9069c0 Sep 08 00:58:48.700585 dv-cinder-847733-3-smb devstack@keystone.service[81661]: python threads support enabled Sep 08 00:58:48.700585 dv-cinder-847733-3-smb devstack@keystone.service[81661]: your server socket listen backlog is limited to 100 connections Sep 08 00:58:48.700585 dv-cinder-847733-3-smb devstack@keystone.service[81661]: your mercy for graceful operations on workers is 90 seconds Sep 08 00:58:48.700930 dv-cinder-847733-3-smb devstack@keystone.service[81661]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 00:58:48.701015 dv-cinder-847733-3-smb devstack@keystone.service[81661]: *** Operational MODE: preforking *** Sep 08 00:58:48.701264 dv-cinder-847733-3-smb devstack@keystone.service[81661]: *** uWSGI is running in multiple interpreter mode *** Sep 08 00:58:48.701264 dv-cinder-847733-3-smb devstack@keystone.service[81661]: spawned uWSGI master process (pid: 81661) Sep 08 00:58:48.701488 dv-cinder-847733-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 08 00:58:48.704218 dv-cinder-847733-3-smb devstack@keystone.service[81661]: spawned uWSGI worker 1 (pid: 81675, cores: 1) Sep 08 00:58:48.704218 dv-cinder-847733-3-smb devstack@keystone.service[81661]: spawned uWSGI worker 2 (pid: 81676, cores: 1) Sep 08 00:58:48.704218 dv-cinder-847733-3-smb devstack@keystone.service[81661]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 00:58:52.949234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 00:58:52.949234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: from cryptography.utils import int_from_bytes Sep 08 00:58:52.950037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 00:58:52.950037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: from cryptography.utils import int_from_bytes Sep 08 00:58:52.950448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 00:58:52.950448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: from cryptography.utils import int_from_bytes Sep 08 00:58:52.950548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 00:58:52.950548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: from cryptography.utils import int_from_bytes Sep 08 00:58:53.000980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 00:58:53.001227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 00:58:53.001352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] command line args: [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 00:58:53.001695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 00:58:53.001903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ================================================================================ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 00:58:53.002073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] admin_token = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.002305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_dir = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.002507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.002703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_source = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.002875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] debug = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.003050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_config_append = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_dir = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.005303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.007302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.007302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.007302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.007302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.007302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.007302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.007302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.008229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.008229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.008354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.008732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.008966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.009246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.009585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.009945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.010552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.010775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] publish_errors = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.010990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.011176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 00:58:53.011287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.011355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 00:58:53.011418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.011624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] command line args: [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 00:58:53.011729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.011804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 00:58:53.011863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.012051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ================================================================================ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 00:58:53.012149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] standard_threads = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.012421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.012774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] admin_token = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.012921 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.012985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_dir = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.013041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.013096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_journal = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.013150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.013378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_json = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.013681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] config_source = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.013883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_stderr = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.014185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] debug = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.014358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_syslog = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.014564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.014806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.014806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.015428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.015428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.015708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.015708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.015708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.015708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.015708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.015708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.016707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.016840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.016840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.016840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.016840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.016840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.018451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.018632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.018632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.018632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.018632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.019191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.019325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.019325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.019680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_config_append = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.019809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.019933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.020062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.020186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_dir = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.020319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.020446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.020575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.020710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.020833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.020962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.021134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.021277 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.021449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.021585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.021676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.021802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.021802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.022119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.022196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.022342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.022342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.022595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.022595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.022732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.022803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.022870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.022870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.023071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.023260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.023403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.023541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.023743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.023876 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.023950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.024024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] publish_errors = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.024100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.024170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.024237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.024305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.024415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.024497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.024646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.024729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.024886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.024961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.025114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.025190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] standard_threads = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.025333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.025449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.025595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.025673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.025770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.025854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.025950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_journal = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.026049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.026125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_json = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.026289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_stderr = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.026364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.026466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] use_syslog = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.026549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.026700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 00:58:53.026777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.026958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.027968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.028139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.028215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.028373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.028450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.028612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.028688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.028842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.028926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.029101 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.029181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.029334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.029437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.029589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.029666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.029830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.029905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.030100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.030177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.030292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.030365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.030534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.030610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.030774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.030853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.031972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.032047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.032213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.032289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.032449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.032525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.032707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.033344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.033517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.033597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.033757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.033840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.033992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.034067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.034230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.034308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.034484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.034616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.034719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.034813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.034948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.035997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.036153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.036240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.036392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.036489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.036627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.036703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.036862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.036985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.037093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.037177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.037321 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.037396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.037576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.037654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.037808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.037895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.038972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.039057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.039210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.039296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.039449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.039529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.039702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.039785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.039936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.external = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.040950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.041112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.041188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.password = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.041340 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.token = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.041442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.041606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.041685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.041840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.041917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.042080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.042165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.042309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.042385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.042554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.042632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.042795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.042945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.043970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.044048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.044212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.044289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.044459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.044536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.044690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.044772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.044928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.045993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.046162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.046239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.046402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.046508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.046654 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.046732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.046892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.046969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.047130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.047206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.047365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.047444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.047601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.047680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.047842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.047919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.048067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.048150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.048326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.048409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.048585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.048669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.048829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.048911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.049063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.049141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.049306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.049382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.049564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.049642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.049802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.049880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.050967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.051987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.052149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.052227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.052378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.052454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.052609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.052688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.052840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.052918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.053085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.053162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.external = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.053323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.053418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.053592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.053671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.053847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.053935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.054088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.password = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.054165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.054322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] auth.token = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.054399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.054562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.054647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.054799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.054877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.055961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.056972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.057145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.057223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.057376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.057494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.057645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.057724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.057891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.057967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.058119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.058206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.058354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.058433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.058583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.058660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.058818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.058903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.059051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.059130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.059290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.059368 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.059526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.059613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.059836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.059913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.060076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.060154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.060320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.060409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.060569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.060651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.060812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.060899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.061044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.061130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.061294 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.061373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.061552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.061630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.061796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.061887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.062987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.063063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.063235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.063320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.063478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.063555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.063714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.063790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.063963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064511 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.064980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.065132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.065210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.065376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.065510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.065636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.065716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.065871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.065949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.066111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.066197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.066356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.066434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.066587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.066664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.066832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.066910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.067068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.067146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.067302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.067380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.067537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.067616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.067772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.067850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.068957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.069996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.070162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.070239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.070477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.070626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.070703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.070863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.070940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.071098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.071176 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.071337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.071421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.071570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.071647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.071807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.071885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.072986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.073062 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.073223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.073302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.073483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.073561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.073720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.074997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.075129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.075235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.075374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.075482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.075619 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.075746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.075864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.075983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.076070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.076234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.076312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.076484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.076561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.076735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.076814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.076974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.077052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.077209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.077392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.077532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.077657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.077735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.077907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.077985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.078144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.078229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.078388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.078465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.078634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.078710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.078865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.078950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.079116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.079195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.079363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.079439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.080119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.080281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.080357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.080426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.080570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.080694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.080799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.080917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.081037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.081116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.081274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.081350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.081546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.081638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.081783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.081860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082253 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.082967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.083999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.084154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.084230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.084392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.084477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.084632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.084708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.084865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.084941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.085101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.085188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.085333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.085429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.085602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.085681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.085859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.085948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.086093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.086178 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.086334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.086413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.086571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.086647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.086813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.086891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.087990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.088067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.088223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.088302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.088456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.088537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.088688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.088766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.088928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.089982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.090137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.090215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.090379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.090458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.090609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.090689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.090847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.091001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.091087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.091232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 00:58:53.091310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.091485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.091742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.091996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.092251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.092489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.092747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.093001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.093242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.093503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.093743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.093980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.094235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.094494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.094745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.094986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.095270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.096015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.096258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.096500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.096751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.096993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.097259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.097535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.097778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.098026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.098272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.098526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.098766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.099010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.099249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.099499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.099780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.100016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.100263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.100531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.100794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.101041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.101291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.101561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.101808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.102286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.102524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.102764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.103012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.103252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.103499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.103736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.103987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.104226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.104479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.104713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.104953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.105191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 00:58:53.105363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 00:58:53.121071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.121301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.121555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.129847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.130220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.130453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.130680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.139258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.158762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.158983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.160400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.160638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.211683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.212073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.260863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.261091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.267395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.267635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.416292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.416481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.416553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.416718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.416803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.416934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.417019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.417149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.417232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.417362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.417478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.417606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.440590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.440821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.440936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441391 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.441918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.442047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.442260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.452894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.452993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.465458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.465656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.465823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.465931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.466920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.467136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 00:58:53.483642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.483850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 00:58:53.484079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.484189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.484299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 00:58:53.484398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 00:58:53.484644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.484734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.484848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 00:58:53.484932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.485125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.485215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.485383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.485487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.485672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.486054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.494973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.495250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.495517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.495628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.495796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.495910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.496184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.496470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.503780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.504469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.506707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.506989 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.507705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.507845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.507978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.508111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.508272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.508403 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.508535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.508664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.508792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.508929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.509071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.509199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.509326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.509495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.509629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.509758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.509884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.510011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.510011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.510253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.532661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.533480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.534180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.534460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.534943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.535232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.539113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.539398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.539678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.539804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.540057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.540342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.546042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.546327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.546846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.547132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.551138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.551433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.551718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.551997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.552080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.552291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.552578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.552864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.553140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.553427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.553699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.553964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.554044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.554320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.554612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.554900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.569942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.570220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.570901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.571180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.574078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.575071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.577301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.577624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.578185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.578484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.582406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.583367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.585614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.586603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.588806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.589102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.589385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.589694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.589776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.589981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.590075 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.590258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.590340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.590667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.590957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.591261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.606050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.606338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.606604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.606862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.607084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.607376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.607646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.607907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.613744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.614692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.615293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.616372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.616810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.617085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.617931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.618212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.619768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.620050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.620330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.620614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.620905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.620995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.621194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.621508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.621797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.622088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.632646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.632930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.633210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.633520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.633887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.633989 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.634169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.634248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.634447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.634527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.634727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.635019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.635308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.635587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.650624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.651861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.653531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.654943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.656395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.657897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.658029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.659376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.659472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.659695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.660083 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.660838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.661123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.661422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.666435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.667884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.667967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.669351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.670781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.671180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.671461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.671733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.672281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.672575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.672859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.673135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.679824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.680128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.680406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.681429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.681733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.682027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.687250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.687532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.687809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.688079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.688350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.688618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.688885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.689500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 00:58:53.689741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.689824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.690011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.690092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.690288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.690378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.690559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.690640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.690823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.690904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.691084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.691165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.691358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.691437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.691628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.691915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.692187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.692461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.692726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.692993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 00:58:53.725629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558d7f9069c0 pid: 81676 (default app) Sep 08 00:58:53.727240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558d7f9069c0 pid: 81675 (default app) Sep 08 00:58:53.728845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88c00-9e25-4253-a51e-f5fd9387a13d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:58:53.729128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88c00-9e25-4253-a51e-f5fd9387a13d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:58:53.729398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88c00-9e25-4253-a51e-f5fd9387a13d None None] PATH_INFO: `/v3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:58:53.733522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Sep 8 00:58:53 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:00.421410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1336b22-736c-4cf6-8242-51cc366ed90e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:00.421916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1336b22-736c-4cf6-8242-51cc366ed90e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:00.422018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1336b22-736c-4cf6-8242-51cc366ed90e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:00.426848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:00.432444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:00.432888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:00.433024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:00.502597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: INFO dbcounter [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] Registered counter for database keystone Sep 08 00:59:00.522104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG oslo_db.sqlalchemy.engines [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 00:59:00.528638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writer thread running {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 00:59:00.705171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG passlib.handlers.bcrypt [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81676) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 00:59:00.705505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG passlib.handlers.bcrypt [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81676) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 00:59:00.763039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:00.764632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:00.893748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 08 00:59:01.321356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1336b22-736c-4cf6-8242-51cc366ed90e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:01.392864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: INFO dbcounter [None req-f1336b22-736c-4cf6-8242-51cc366ed90e None None] Registered counter for database keystone Sep 08 00:59:01.414360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG oslo_db.sqlalchemy.engines [None req-f1336b22-736c-4cf6-8242-51cc366ed90e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 00:59:01.420550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writer thread running {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 00:59:01.538606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1336b22-736c-4cf6-8242-51cc366ed90e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:01.542827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe899f-cc46-4e0d-93c7-c64368be0718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:01.543447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe899f-cc46-4e0d-93c7-c64368be0718 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:01.543724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe899f-cc46-4e0d-93c7-c64368be0718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:01.543990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe899f-cc46-4e0d-93c7-c64368be0718 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:01.552164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe899f-cc46-4e0d-93c7-c64368be0718 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:01.603966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6cfe899f-cc46-4e0d-93c7-c64368be0718 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 00:59:01.604254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe899f-cc46-4e0d-93c7-c64368be0718 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:01.613691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Sep 8 00:59:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 00:59:01.619605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:01.639620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292604e3-b543-4be0-8d99-ed727a549ad4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:01.644839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a7461-9fb2-4b83-b283-1fdc6ae440d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:01.645971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a7461-9fb2-4b83-b283-1fdc6ae440d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:01.646258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a7461-9fb2-4b83-b283-1fdc6ae440d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:01.646534 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a7461-9fb2-4b83-b283-1fdc6ae440d4 admin admin] PATH_INFO: `/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:01.648148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a7461-9fb2-4b83-b283-1fdc6ae440d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1a2335b6b0e4e3b94d114442755e8d9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:01.700249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING keystone.common.rbac_enforcer.enforcer [None req-887a7461-9fb2-4b83-b283-1fdc6ae440d4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 00:59:01.700598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a7461-9fb2-4b83-b283-1fdc6ae440d4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:01.705763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Sep 8 00:59:01 2022] GET /identity/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:03.814775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd64a-bc74-48d7-b44f-597437afa3e6 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:03.815299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd64a-bc74-48d7-b44f-597437afa3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:03.815299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd64a-bc74-48d7-b44f-597437afa3e6 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:03.819361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:03.824795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c625a7-98b7-401a-86d1-9931bdcd54ab None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:03.825218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c625a7-98b7-401a-86d1-9931bdcd54ab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:03.825341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c625a7-98b7-401a-86d1-9931bdcd54ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:03.846897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-03c625a7-98b7-401a-86d1-9931bdcd54ab None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:03.848411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-03c625a7-98b7-401a-86d1-9931bdcd54ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:03.856226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 08 00:59:04.119069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd64a-bc74-48d7-b44f-597437afa3e6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:04.131466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd64a-bc74-48d7-b44f-597437afa3e6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:04.135571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f10d7-fc65-447e-868b-df7c52d31f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:04.136159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f10d7-fc65-447e-868b-df7c52d31f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:04.136439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f10d7-fc65-447e-868b-df7c52d31f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:04.136712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f10d7-fc65-447e-868b-df7c52d31f75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:04.145031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f10d7-fc65-447e-868b-df7c52d31f75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:04.146819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f10d7-fc65-447e-868b-df7c52d31f75 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:04.155397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Sep 8 00:59:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 00:59:04.160490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c625a7-98b7-401a-86d1-9931bdcd54ab None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:04.169512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c625a7-98b7-401a-86d1-9931bdcd54ab None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:04.173854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16aebc-d051-4737-b531-637db4d5b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:04.174472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16aebc-d051-4737-b531-637db4d5b0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:04.174753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16aebc-d051-4737-b531-637db4d5b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:04.175041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16aebc-d051-4737-b531-637db4d5b0d4 admin admin] PATH_INFO: `/v3/users/802225de4e5b4f0395304da25f9b41c5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:04.176324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16aebc-d051-4737-b531-637db4d5b0d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=802225de4e5b4f0395304da25f9b41c5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:04.178168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16aebc-d051-4737-b531-637db4d5b0d4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:04.179677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Sep 8 00:59:04 2022] GET /identity/v3/users/802225de4e5b4f0395304da25f9b41c5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:06.380268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e0b11-c431-4b5c-803e-6bce8559cc92 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:06.380801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e0b11-c431-4b5c-803e-6bce8559cc92 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:06.380801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e0b11-c431-4b5c-803e-6bce8559cc92 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:06.382172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:06.387234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c2f34-7c5f-440d-9914-3de06a5490b4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:06.387906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c2f34-7c5f-440d-9914-3de06a5490b4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:06.388045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c2f34-7c5f-440d-9914-3de06a5490b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:06.406405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2f9c2f34-7c5f-440d-9914-3de06a5490b4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:06.407630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2f9c2f34-7c5f-440d-9914-3de06a5490b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:06.439382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20581c8c-287e-4f78-9a0d-8c2ad352ca9c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:06.439663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20581c8c-287e-4f78-9a0d-8c2ad352ca9c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:06.439933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20581c8c-287e-4f78-9a0d-8c2ad352ca9c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:06.441259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:06.446167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:06.446453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:06.446728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:06.489251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG passlib.handlers.bcrypt [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81675) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 00:59:06.489677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG passlib.handlers.bcrypt [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81675) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 00:59:06.490016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:06.539150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:06.540755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:06.638666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:06.754032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c2f34-7c5f-440d-9914-3de06a5490b4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:06.777535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:06.857207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c2f34-7c5f-440d-9914-3de06a5490b4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:06.890185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147745a-310a-4818-94c1-4f321c23963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:06.890752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147745a-310a-4818-94c1-4f321c23963c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:06.891034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147745a-310a-4818-94c1-4f321c23963c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:06.891309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147745a-310a-4818-94c1-4f321c23963c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:06.900292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:06.902310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147745a-310a-4818-94c1-4f321c23963c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f147745a-310a-4818-94c1-4f321c23963c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:06.911614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:06.912627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:06.913483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:06.918350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147745a-310a-4818-94c1-4f321c23963c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:06.999580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:07.007413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b28af-fc99-4091-9711-ed0935619677 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:07.009722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:07.018796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147745a-310a-4818-94c1-4f321c23963c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:07.043767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859045-d7d4-4095-97c6-512fca25cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:07.044632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859045-d7d4-4095-97c6-512fca25cb59 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:07.044922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859045-d7d4-4095-97c6-512fca25cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:07.045194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859045-d7d4-4095-97c6-512fca25cb59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:07.052836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:07.053467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:07.053755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:07.054028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:07.054705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:07.055005 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:07.056398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:07.067927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:07.073614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:07.112770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72859045-d7d4-4095-97c6-512fca25cb59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:07.114311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72859045-d7d4-4095-97c6-512fca25cb59 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:07.169742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa0eb-b632-451c-b88a-c2353e895000 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:07.202696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c5a29-ae6c-4f4b-9112-0c01bce50ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:07.203304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c5a29-ae6c-4f4b-9112-0c01bce50ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:07.203604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c5a29-ae6c-4f4b-9112-0c01bce50ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:07.203928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c5a29-ae6c-4f4b-9112-0c01bce50ca0 None admin] PATH_INFO: `/v3/users/802225de4e5b4f0395304da25f9b41c5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:07.205142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c5a29-ae6c-4f4b-9112-0c01bce50ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=802225de4e5b4f0395304da25f9b41c5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:07.206599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c5a29-ae6c-4f4b-9112-0c01bce50ca0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:07.208134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 9/16] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:07 2022] GET /identity/v3/users/802225de4e5b4f0395304da25f9b41c5 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:07.210541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 00:59:07.213434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c5a29-ae6c-4f4b-9112-0c01bce50ca0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:07.215770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859045-d7d4-4095-97c6-512fca25cb59 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:07.218534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:07.228480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:07.312233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c5a29-ae6c-4f4b-9112-0c01bce50ca0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:07.315015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859045-d7d4-4095-97c6-512fca25cb59 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:07.346527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d7367-4502-45a3-8673-ab7b43f00898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:07.347142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d7367-4502-45a3-8673-ab7b43f00898 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:07.347420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d7367-4502-45a3-8673-ab7b43f00898 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:07.347688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d7367-4502-45a3-8673-ab7b43f00898 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:07.347840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:07.348671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:07.348771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d7367-4502-45a3-8673-ab7b43f00898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:07.348950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:07.349221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:07.350231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d7367-4502-45a3-8673-ab7b43f00898 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:07.351909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:07.357424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d7367-4502-45a3-8673-ab7b43f00898 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:07.368238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:07.369871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 00:59:07.388730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:07.390072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 00:59:07.390865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 00:59:07.390865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 00:59:07.390865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:07.390865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:07.396388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:07.437277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:07.453545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:07.459169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d7367-4502-45a3-8673-ab7b43f00898 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:07.493286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baf0ab-e1a0-4970-a0c2-b34b62bddfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:07.493922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf0ab-e1a0-4970-a0c2-b34b62bddfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:07.494200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf0ab-e1a0-4970-a0c2-b34b62bddfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:07.494471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf0ab-e1a0-4970-a0c2-b34b62bddfe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:07.495190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf0ab-e1a0-4970-a0c2-b34b62bddfe0 None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.domain.id=default, user.id=802225de4e5b4f0395304da25f9b41c5) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:07.495495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf0ab-e1a0-4970-a0c2-b34b62bddfe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:07.496914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf0ab-e1a0-4970-a0c2-b34b62bddfe0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:07.498192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d0052-c3b6-40a5-88ff-066d558273a1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:07.503840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Sep 8 00:59:07 2022] GET /identity/v3/role_assignments?user.id=802225de4e5b4f0395304da25f9b41c5&scope.domain.id=default&role.id=c182619b007b495f912901d866e751e1 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:07.534659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d62b9-56bb-4416-b367-10b58d02c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:07.535310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d62b9-56bb-4416-b367-10b58d02c541 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:07.535573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d62b9-56bb-4416-b367-10b58d02c541 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:07.535846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d62b9-56bb-4416-b367-10b58d02c541 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:07.536523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d62b9-56bb-4416-b367-10b58d02c541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:07.536828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d62b9-56bb-4416-b367-10b58d02c541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:07.538280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d62b9-56bb-4416-b367-10b58d02c541 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:07.557864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 00:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:09.864527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282fb8-672d-4471-a53e-af54643b529f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:09.864998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282fb8-672d-4471-a53e-af54643b529f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:09.864998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282fb8-672d-4471-a53e-af54643b529f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:09.866379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:09.880028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d461f84-201d-4551-ab1c-616adadba26d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:09.880957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d461f84-201d-4551-ab1c-616adadba26d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:09.881537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d461f84-201d-4551-ab1c-616adadba26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:09.906047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7d461f84-201d-4551-ab1c-616adadba26d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:09.907637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7d461f84-201d-4551-ab1c-616adadba26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:09.995056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:10.237352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093bd4-e6f5-44e6-9c69-71b14b9309e7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:10.238106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093bd4-e6f5-44e6-9c69-71b14b9309e7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:10.238583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093bd4-e6f5-44e6-9c69-71b14b9309e7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:10.240229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:10.245762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fedd4-a742-464f-9889-0280965b2b6a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:10.246275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fedd4-a742-464f-9889-0280965b2b6a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:10.246759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fedd4-a742-464f-9889-0280965b2b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:10.274351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8c6fedd4-a742-464f-9889-0280965b2b6a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:10.275847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8c6fedd4-a742-464f-9889-0280965b2b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:10.332640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:10.367974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:10.505536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0093bd4-e6f5-44e6-9c69-71b14b9309e7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:10.618262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0968-ff1b-4b2b-8c1c-933e422e252f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:10.618899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0968-ff1b-4b2b-8c1c-933e422e252f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:10.619370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0968-ff1b-4b2b-8c1c-933e422e252f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:10.620918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:10.637240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdb36-f58f-4182-9616-6624bd007630 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:10.638116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdb36-f58f-4182-9616-6624bd007630 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:10.638586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdb36-f58f-4182-9616-6624bd007630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:10.653450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0093bd4-e6f5-44e6-9c69-71b14b9309e7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:10.682423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-820bdb36-f58f-4182-9616-6624bd007630 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:10.683980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-820bdb36-f58f-4182-9616-6624bd007630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:10.715715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f040-c515-4d65-b0c8-eaef3599f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:10.716415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f040-c515-4d65-b0c8-eaef3599f015 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:10.716697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f040-c515-4d65-b0c8-eaef3599f015 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:10.716968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f040-c515-4d65-b0c8-eaef3599f015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:10.742318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13f040-c515-4d65-b0c8-eaef3599f015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ad13f040-c515-4d65-b0c8-eaef3599f015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:10.747372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:10.748206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:10.748951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 14/27] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:10.754726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260003e-09f7-400a-82f5-23b6b3c71052 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:10.755015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260003e-09f7-400a-82f5-23b6b3c71052 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:10.755289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260003e-09f7-400a-82f5-23b6b3c71052 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:10.756924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 15/28] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:10.761779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260003e-09f7-400a-82f5-23b6b3c71052 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:10.770700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:10.800583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 14/29] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:10.803992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bc81a-e643-4454-9c98-61aa8ffa69b6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:10.804709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bc81a-e643-4454-9c98-61aa8ffa69b6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:10.805754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bc81a-e643-4454-9c98-61aa8ffa69b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:10.841749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5e6bc81a-e643-4454-9c98-61aa8ffa69b6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:10.844486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5e6bc81a-e643-4454-9c98-61aa8ffa69b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:10.964889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:10.965872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bc81a-e643-4454-9c98-61aa8ffa69b6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:10.975577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260003e-09f7-400a-82f5-23b6b3c71052 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:11.056140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:11.063719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:11.064667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.065170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.065696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.066628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:11.067158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:11.068825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:11.089262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:11.090390 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:11.131309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bc81a-e643-4454-9c98-61aa8ffa69b6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:11.194150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:11.194789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.195068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.195343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.210865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:11.212344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:11.215475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 00:59:11.243111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:11.244013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 00:59:11.244788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 00:59:11.244788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 00:59:11.244788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:11.246241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:11.251907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:11.281947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f8b0-ccf8-414f-9017-33d2659847af None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:11.352476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8ae1-1f35-420d-8a7e-a2b1f96172b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:11.353008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8ae1-1f35-420d-8a7e-a2b1f96172b5 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.353284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8ae1-1f35-420d-8a7e-a2b1f96172b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.353580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8ae1-1f35-420d-8a7e-a2b1f96172b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.354257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8ae1-1f35-420d-8a7e-a2b1f96172b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:11.355649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8ae1-1f35-420d-8a7e-a2b1f96172b5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:11.401831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:11.414772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f920252-b2fd-412d-9569-2655cb416a04 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:11.452035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83dd1b-9f1b-4eda-8905-eaadc6b746e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:11.452668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83dd1b-9f1b-4eda-8905-eaadc6b746e7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.452946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83dd1b-9f1b-4eda-8905-eaadc6b746e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.453219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83dd1b-9f1b-4eda-8905-eaadc6b746e7 None admin] PATH_INFO: `/v3/users/802225de4e5b4f0395304da25f9b41c5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.455375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83dd1b-9f1b-4eda-8905-eaadc6b746e7 None admin] RBAC: Authorizing `identity:get_user(user_id=802225de4e5b4f0395304da25f9b41c5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:11.456869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83dd1b-9f1b-4eda-8905-eaadc6b746e7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:11.458909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 17/33] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:11 2022] GET /identity/v3/users/802225de4e5b4f0395304da25f9b41c5 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:11.459789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83dd1b-9f1b-4eda-8905-eaadc6b746e7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:11.502294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 8 00:59:11 2022] POST /identity/v3/roles => generated 219 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:11.509357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8ae1-1f35-420d-8a7e-a2b1f96172b5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:11.584916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83dd1b-9f1b-4eda-8905-eaadc6b746e7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:11.632451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:11.633113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.633425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.633705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.634374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:11.634678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:11.636121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:11.652260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 00:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:11.653153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:11.653803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8ae1-1f35-420d-8a7e-a2b1f96172b5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:11.676355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:11.686770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:11.698705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a0d0-544a-43f0-9a5d-af758775c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:11.699581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a0d0-544a-43f0-9a5d-af758775c222 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.699981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a0d0-544a-43f0-9a5d-af758775c222 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.700403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a0d0-544a-43f0-9a5d-af758775c222 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.701281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7a0d0-544a-43f0-9a5d-af758775c222 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:11.703704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7a0d0-544a-43f0-9a5d-af758775c222 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:11.726677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 18/36] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 8 00:59:11 2022] POST /identity/v3/roles => generated 225 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:11.727535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a0d0-544a-43f0-9a5d-af758775c222 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:11.811493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eecb62-7236-4bc3-869a-41b509f9d2e2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:11.864966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665da782-1a8c-4668-9841-44a1a6726427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:11.866151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665da782-1a8c-4668-9841-44a1a6726427 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.866635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665da782-1a8c-4668-9841-44a1a6726427 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.867087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665da782-1a8c-4668-9841-44a1a6726427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.868571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665da782-1a8c-4668-9841-44a1a6726427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:11.870296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665da782-1a8c-4668-9841-44a1a6726427 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:11.872478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 19/37] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:11.874046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915e27-d7df-476e-beba-a5e99d38ecc1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.874513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915e27-d7df-476e-beba-a5e99d38ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.875002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915e27-d7df-476e-beba-a5e99d38ecc1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.876982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 20/38] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:11.878599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4f37f-c118-4f31-ba99-74079c5361ac None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.879113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4f37f-c118-4f31-ba99-74079c5361ac None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.879648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4f37f-c118-4f31-ba99-74079c5361ac None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.881195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 21/39] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:11.882564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b9b36-3d03-4420-81bd-1ceddb8a67fd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.883086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b9b36-3d03-4420-81bd-1ceddb8a67fd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.883643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b9b36-3d03-4420-81bd-1ceddb8a67fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.905330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f24b9b36-3d03-4420-81bd-1ceddb8a67fd None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:11.906999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f24b9b36-3d03-4420-81bd-1ceddb8a67fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:11.908765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a0d0-544a-43f0-9a5d-af758775c222 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:11.953985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bb724-b4a4-4fa3-b166-519b16db68ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:11.955284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bb724-b4a4-4fa3-b166-519b16db68ed None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:11.955682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bb724-b4a4-4fa3-b166-519b16db68ed None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:11.955965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bb724-b4a4-4fa3-b166-519b16db68ed None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:11.956624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bb724-b4a4-4fa3-b166-519b16db68ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:11.959090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bb724-b4a4-4fa3-b166-519b16db68ed None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:11.992677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 19/40] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 00:59:11 2022] POST /identity/v3/projects => generated 301 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:11.993283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bb724-b4a4-4fa3-b166-519b16db68ed None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:12.002194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:12.004058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822abb-d2cd-4834-b841-66e4b3ef912e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:12.004474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822abb-d2cd-4834-b841-66e4b3ef912e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:12.004871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822abb-d2cd-4834-b841-66e4b3ef912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:12.029448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ad822abb-d2cd-4834-b841-66e4b3ef912e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:12.031059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ad822abb-d2cd-4834-b841-66e4b3ef912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:12.047182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:12.054585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:12.131744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:12.132781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bb724-b4a4-4fa3-b166-519b16db68ed None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:12.175753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a24da-c45c-4f78-9496-548b6ee6c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:12.176568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a24da-c45c-4f78-9496-548b6ee6c13b None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:12.176915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a24da-c45c-4f78-9496-548b6ee6c13b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:12.177204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a24da-c45c-4f78-9496-548b6ee6c13b None admin] PATH_INFO: `/v3/domains/default/users/802225de4e5b4f0395304da25f9b41c5/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:12.179452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a24da-c45c-4f78-9496-548b6ee6c13b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=802225de4e5b4f0395304da25f9b41c5, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:12.180956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a24da-c45c-4f78-9496-548b6ee6c13b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:12.200546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 20/43] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Sep 8 00:59:11 2022] PUT /identity/v3/domains/default/users/802225de4e5b4f0395304da25f9b41c5/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:12.327533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822abb-d2cd-4834-b841-66e4b3ef912e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:12.443094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822abb-d2cd-4834-b841-66e4b3ef912e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:12.443395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a24da-c45c-4f78-9496-548b6ee6c13b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:12.481894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efd849-2852-43e3-841c-7aea5f4fdc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:12.482539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efd849-2852-43e3-841c-7aea5f4fdc5c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:12.482819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efd849-2852-43e3-841c-7aea5f4fdc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:12.483095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efd849-2852-43e3-841c-7aea5f4fdc5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:12.484229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efd849-2852-43e3-841c-7aea5f4fdc5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:12.487573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efd849-2852-43e3-841c-7aea5f4fdc5c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:12.489428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 24/44] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:12.494694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efd849-2852-43e3-841c-7aea5f4fdc5c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:12.520149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:12.565143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:12.570643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a24da-c45c-4f78-9496-548b6ee6c13b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:12.608796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fc07c-241d-49da-baad-bc8075b1c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:12.609420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc07c-241d-49da-baad-bc8075b1c218 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:12.609714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc07c-241d-49da-baad-bc8075b1c218 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:12.610178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc07c-241d-49da-baad-bc8075b1c218 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:12.611187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fc07c-241d-49da-baad-bc8075b1c218 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:12.612566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fc07c-241d-49da-baad-bc8075b1c218 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:12.613714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efd849-2852-43e3-841c-7aea5f4fdc5c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:12.629547 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 21/45] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 8 00:59:12 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 00:59:12.661481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96090e-25ba-4e57-ba4c-5d8f6fb8ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:12.662827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96090e-25ba-4e57-ba4c-5d8f6fb8ee88 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:12.663115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96090e-25ba-4e57-ba4c-5d8f6fb8ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:12.663392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96090e-25ba-4e57-ba4c-5d8f6fb8ee88 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:12.664091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96090e-25ba-4e57-ba4c-5d8f6fb8ee88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:12.665612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96090e-25ba-4e57-ba4c-5d8f6fb8ee88 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:12.809998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 25/46] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 00:59:12 2022] POST /identity/v3/projects => generated 312 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 00:59:14.363319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f890-daba-4464-b5e7-16b910dab7ed None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:14.363835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f890-daba-4464-b5e7-16b910dab7ed None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:14.363835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f890-daba-4464-b5e7-16b910dab7ed None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:14.365122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 22/47] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:14.370740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89564a4-ae3c-4fa9-8e3d-366a9fedda4e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:14.371114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89564a4-ae3c-4fa9-8e3d-366a9fedda4e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:14.371305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89564a4-ae3c-4fa9-8e3d-366a9fedda4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:14.390490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f89564a4-ae3c-4fa9-8e3d-366a9fedda4e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:14.392018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f89564a4-ae3c-4fa9-8e3d-366a9fedda4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:14.450170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:14.459701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:14.728871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f890-daba-4464-b5e7-16b910dab7ed None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:14.941012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f890-daba-4464-b5e7-16b910dab7ed None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:14.961311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6901a7-b20e-4e63-b08c-da1f1939d7ea None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:14.961642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6901a7-b20e-4e63-b08c-da1f1939d7ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:14.961927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6901a7-b20e-4e63-b08c-da1f1939d7ea None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:14.963276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 27/49] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:14.968097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafff2e-a78e-45fa-9ad6-fa1e7624a124 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:14.968385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafff2e-a78e-45fa-9ad6-fa1e7624a124 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:14.968661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafff2e-a78e-45fa-9ad6-fa1e7624a124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:14.976411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8668be-8e53-490a-92a0-03c6d9ab15c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:14.977051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8668be-8e53-490a-92a0-03c6d9ab15c5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:14.977335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8668be-8e53-490a-92a0-03c6d9ab15c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:14.977633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8668be-8e53-490a-92a0-03c6d9ab15c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:14.988645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8668be-8e53-490a-92a0-03c6d9ab15c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cf8668be-8e53-490a-92a0-03c6d9ab15c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:14.993679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:14.994752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:14.996001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 23/50] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:15.002786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8668be-8e53-490a-92a0-03c6d9ab15c5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:15.026935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:15.090316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ebafff2e-a78e-45fa-9ad6-fa1e7624a124 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:15.091533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ebafff2e-a78e-45fa-9ad6-fa1e7624a124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:15.111473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8668be-8e53-490a-92a0-03c6d9ab15c5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:15.145672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:15.146288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:15.146568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:15.146842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:15.147506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:15.147808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:15.149215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:15.157675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 24/51] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:15.158267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 28/52] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:15.163549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:15.240310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:15.259816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57970766-0660-4b09-b3e1-1687f9f1d71e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:15.292161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6274-f366-46f8-b61d-049f349f484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:15.292775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6274-f366-46f8-b61d-049f349f484a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:15.293054 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6274-f366-46f8-b61d-049f349f484a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:15.293325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6274-f366-46f8-b61d-049f349f484a None admin] PATH_INFO: `/v3/users/802225de4e5b4f0395304da25f9b41c5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:15.294461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6274-f366-46f8-b61d-049f349f484a None admin] RBAC: Authorizing `identity:get_user(user_id=802225de4e5b4f0395304da25f9b41c5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:15.295882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6274-f366-46f8-b61d-049f349f484a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:15.297448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 25/53] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:15 2022] GET /identity/v3/users/802225de4e5b4f0395304da25f9b41c5 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:15.303006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafff2e-a78e-45fa-9ad6-fa1e7624a124 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:15.404457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafff2e-a78e-45fa-9ad6-fa1e7624a124 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:15.425161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6274-f366-46f8-b61d-049f349f484a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:15.427970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:15.439331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e080-942b-4645-999b-69d1064a13ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:15.439966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e080-942b-4645-999b-69d1064a13ad None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:15.440251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e080-942b-4645-999b-69d1064a13ad None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:15.440528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e080-942b-4645-999b-69d1064a13ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:15.441693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4e080-942b-4645-999b-69d1064a13ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:15.443273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4e080-942b-4645-999b-69d1064a13ad None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:15.444856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 29/54] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:15.450523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e080-942b-4645-999b-69d1064a13ad None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:15.530738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6274-f366-46f8-b61d-049f349f484a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:15.552506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e080-942b-4645-999b-69d1064a13ad None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:15.565608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c886ab1-7746-4acd-bc81-bd56934c9df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:15.566242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886ab1-7746-4acd-bc81-bd56934c9df2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:15.566520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886ab1-7746-4acd-bc81-bd56934c9df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:15.566790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c886ab1-7746-4acd-bc81-bd56934c9df2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:15.567930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c886ab1-7746-4acd-bc81-bd56934c9df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:15.569391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c886ab1-7746-4acd-bc81-bd56934c9df2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:15.571159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 26/55] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:15.576308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c886ab1-7746-4acd-bc81-bd56934c9df2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:15.585992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0b9bb-587a-48ba-99f4-e4ff1b360abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:15.586632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0b9bb-587a-48ba-99f4-e4ff1b360abd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:15.586916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0b9bb-587a-48ba-99f4-e4ff1b360abd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:15.587193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0b9bb-587a-48ba-99f4-e4ff1b360abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:15.587925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0b9bb-587a-48ba-99f4-e4ff1b360abd None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.domain.id=default, user.id=802225de4e5b4f0395304da25f9b41c5) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:15.588238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0b9bb-587a-48ba-99f4-e4ff1b360abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:15.589706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0b9bb-587a-48ba-99f4-e4ff1b360abd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:15.594283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:15.598591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 30/56] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Sep 8 00:59:15 2022] GET /identity/v3/role_assignments?user.id=802225de4e5b4f0395304da25f9b41c5&scope.domain.id=default&role.id=c182619b007b495f912901d866e751e1 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:15.681872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c886ab1-7746-4acd-bc81-bd56934c9df2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:15.716898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecdcf0-55ee-4626-9a8c-da6dea7eaeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:15.717555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdcf0-55ee-4626-9a8c-da6dea7eaeb9 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:15.717840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdcf0-55ee-4626-9a8c-da6dea7eaeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:15.718113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdcf0-55ee-4626-9a8c-da6dea7eaeb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:15.718778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecdcf0-55ee-4626-9a8c-da6dea7eaeb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:15.720405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecdcf0-55ee-4626-9a8c-da6dea7eaeb9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:15.749283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 27/57] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Sep 8 00:59:15 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 00:59:17.888761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d203d-8195-45fa-8ef9-de4730345e8c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:17.889256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d203d-8195-45fa-8ef9-de4730345e8c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:17.889344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d203d-8195-45fa-8ef9-de4730345e8c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:17.890687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 31/58] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:17.896615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd8e2-eb53-41fa-a088-42d2e036cfdd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:17.897110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd8e2-eb53-41fa-a088-42d2e036cfdd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:17.897631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebd8e2-eb53-41fa-a088-42d2e036cfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:17.916996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a5ebd8e2-eb53-41fa-a088-42d2e036cfdd None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:17.918568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a5ebd8e2-eb53-41fa-a088-42d2e036cfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:17.978282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:17.984294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:18.252076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d203d-8195-45fa-8ef9-de4730345e8c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:18.308207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:18.351363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d203d-8195-45fa-8ef9-de4730345e8c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:18.384322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214be40e-05f9-48e9-9755-b48aa9007609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:18.384941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be40e-05f9-48e9-9755-b48aa9007609 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:18.385228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be40e-05f9-48e9-9755-b48aa9007609 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:18.385533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be40e-05f9-48e9-9755-b48aa9007609 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:18.386643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214be40e-05f9-48e9-9755-b48aa9007609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:18.388356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214be40e-05f9-48e9-9755-b48aa9007609 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:18.389923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 32/60] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:18.396775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebd8e2-eb53-41fa-a088-42d2e036cfdd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:18.491335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebd8e2-eb53-41fa-a088-42d2e036cfdd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:18.525248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315141c8-13ab-44a0-b300-179247438ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:18.525885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315141c8-13ab-44a0-b300-179247438ec3 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:18.526171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315141c8-13ab-44a0-b300-179247438ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:18.526445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315141c8-13ab-44a0-b300-179247438ec3 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:18.527085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315141c8-13ab-44a0-b300-179247438ec3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:18.528534 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315141c8-13ab-44a0-b300-179247438ec3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:18.554682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 29/61] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 00:59:18 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:21.646013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8783f-e4c0-4a2b-befd-e1d525d0478b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:21.647010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8783f-e4c0-4a2b-befd-e1d525d0478b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:21.647497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8783f-e4c0-4a2b-befd-e1d525d0478b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:21.649067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 33/62] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:21.654453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2681-00df-448e-bf75-42d2757737f9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:21.655228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2681-00df-448e-bf75-42d2757737f9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:21.655696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2681-00df-448e-bf75-42d2757737f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:21.676141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-558a2681-00df-448e-bf75-42d2757737f9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:21.677688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-558a2681-00df-448e-bf75-42d2757737f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:21.743246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:21.765868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 30/63] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:22.027334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251ba0-2f90-48d3-b435-ea0dd119afe8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.027687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251ba0-2f90-48d3-b435-ea0dd119afe8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.027912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251ba0-2f90-48d3-b435-ea0dd119afe8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.029619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 34/64] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:22.035990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4b92-4ed6-4982-954b-e7aef9ba29d3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.036520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4b92-4ed6-4982-954b-e7aef9ba29d3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.036988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4b92-4ed6-4982-954b-e7aef9ba29d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.055821 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8f6b-8570-4a6f-97b2-552feb75a661 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.056435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8f6b-8570-4a6f-97b2-552feb75a661 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.056904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8f6b-8570-4a6f-97b2-552feb75a661 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.058457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 35/65] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:22.059988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-afcc4b92-4ed6-4982-954b-e7aef9ba29d3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:22.061367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-afcc4b92-4ed6-4982-954b-e7aef9ba29d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:22.064000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839965-4af3-4e3e-9f9d-95e70a766aa6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.064489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839965-4af3-4e3e-9f9d-95e70a766aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.064963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839965-4af3-4e3e-9f9d-95e70a766aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.091605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9d839965-4af3-4e3e-9f9d-95e70a766aa6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:22.093830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9d839965-4af3-4e3e-9f9d-95e70a766aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:22.196260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 31/66] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:22.201806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc4b92-4ed6-4982-954b-e7aef9ba29d3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:22.213736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 36/67] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:22.356241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc4b92-4ed6-4982-954b-e7aef9ba29d3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:22.378726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:22.410794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047726aa-5e2f-429d-aca7-c3e06592ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:22.411700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047726aa-5e2f-429d-aca7-c3e06592ec84 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.412133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047726aa-5e2f-429d-aca7-c3e06592ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.412576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047726aa-5e2f-429d-aca7-c3e06592ec84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.431399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047726aa-5e2f-429d-aca7-c3e06592ec84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-047726aa-5e2f-429d-aca7-c3e06592ec84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:22.436587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:22.437636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:22.439151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:22.441381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 32/68] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:22.447749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d839965-4af3-4e3e-9f9d-95e70a766aa6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:22.489364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047726aa-5e2f-429d-aca7-c3e06592ec84 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:22.533808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:22.586875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d839965-4af3-4e3e-9f9d-95e70a766aa6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:22.602127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047726aa-5e2f-429d-aca7-c3e06592ec84 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:22.629654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731672-b9c5-4eb9-b259-e1ea6260c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:22.631339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731672-b9c5-4eb9-b259-e1ea6260c976 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.631800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731672-b9c5-4eb9-b259-e1ea6260c976 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.632352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731672-b9c5-4eb9-b259-e1ea6260c976 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.633323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f731672-b9c5-4eb9-b259-e1ea6260c976 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:22.633783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f731672-b9c5-4eb9-b259-e1ea6260c976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:22.635385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f731672-b9c5-4eb9-b259-e1ea6260c976 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:22.638018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8d8df-4891-4116-b502-533fe18c6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:22.638657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d8df-4891-4116-b502-533fe18c6c2a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.638945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d8df-4891-4116-b502-533fe18c6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.639222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d8df-4891-4116-b502-533fe18c6c2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.649561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 37/69] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:22.650387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8d8df-4891-4116-b502-533fe18c6c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:22.651327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ed802-a3cc-4a41-9b27-7d204d5979b1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.651623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ed802-a3cc-4a41-9b27-7d204d5979b1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.651913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ed802-a3cc-4a41-9b27-7d204d5979b1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.653259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 38/70] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:22.653865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ed802-a3cc-4a41-9b27-7d204d5979b1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2ac8d8df-4891-4116-b502-533fe18c6c2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:22.655629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:22.656707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:22.657531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 33/71] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 00:59:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:22.658177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf3c5-7c02-4d1e-85e5-a419c4e2e9ec None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.659040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf3c5-7c02-4d1e-85e5-a419c4e2e9ec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.659040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf3c5-7c02-4d1e-85e5-a419c4e2e9ec None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.660492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 34/72] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:22.665351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bf3c5-7c02-4d1e-85e5-a419c4e2e9ec None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:22.700653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:22.757460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ed802-a3cc-4a41-9b27-7d204d5979b1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:22.766287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bf3c5-7c02-4d1e-85e5-a419c4e2e9ec None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:22.774318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:22.792635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c5a5e-5d16-42bb-8828-f5259a1012e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:22.793267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c5a5e-5d16-42bb-8828-f5259a1012e8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.793583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c5a5e-5d16-42bb-8828-f5259a1012e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.793865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c5a5e-5d16-42bb-8828-f5259a1012e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.799566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639061b-14c0-4ddc-a59f-0d9a2332dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:22.800201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639061b-14c0-4ddc-a59f-0d9a2332dcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.800488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639061b-14c0-4ddc-a59f-0d9a2332dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.800768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639061b-14c0-4ddc-a59f-0d9a2332dcd3 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.804936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c5a5e-5d16-42bb-8828-f5259a1012e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f07c5a5e-5d16-42bb-8828-f5259a1012e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:22.811329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:22.812319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:22.813776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 39/73] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:22.814502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4181fd-e530-4f51-a5d3-e23d472edd90 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.814502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4181fd-e530-4f51-a5d3-e23d472edd90 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.814643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4181fd-e530-4f51-a5d3-e23d472edd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.817256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639061b-14c0-4ddc-a59f-0d9a2332dcd3 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:22.818871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639061b-14c0-4ddc-a59f-0d9a2332dcd3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:22.820592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 35/74] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:22 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:22.821432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639061b-14c0-4ddc-a59f-0d9a2332dcd3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:22.833312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1b4181fd-e530-4f51-a5d3-e23d472edd90 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:22.834556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1b4181fd-e530-4f51-a5d3-e23d472edd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:22.899746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 40/75] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:22.900960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a6cc-6913-4cc4-9ca6-2d010e007908 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.901247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a6cc-6913-4cc4-9ca6-2d010e007908 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.901555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a6cc-6913-4cc4-9ca6-2d010e007908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.912153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:22.921749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-45c0a6cc-6913-4cc4-9ca6-2d010e007908 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:22.923390 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639061b-14c0-4ddc-a59f-0d9a2332dcd3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:22.923562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-45c0a6cc-6913-4cc4-9ca6-2d010e007908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:22.956501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:22.957115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:22.957395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:22.957709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:22.958350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:22.958692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:22.960020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:22.967737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 36/76] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 00:59:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:22.968516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.000924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 41/77] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:23.005735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a6cc-6913-4cc4-9ca6-2d010e007908 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.046724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.100392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf86c-af68-4fb4-874b-39dd6f275f70 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.126420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a6cc-6913-4cc4-9ca6-2d010e007908 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.146050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.146985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.147332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.147672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.148791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:23.149215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:23.150764 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:23.164101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 37/78] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:23.165063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.168335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ead960-570e-41c5-969f-3e0740855506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.168952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ead960-570e-41c5-969f-3e0740855506 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.169281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ead960-570e-41c5-969f-3e0740855506 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.169557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ead960-570e-41c5-969f-3e0740855506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.183819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.242544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ead960-570e-41c5-969f-3e0740855506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:23.244005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ead960-570e-41c5-969f-3e0740855506 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:23.270323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2e52-7eb7-4c0f-9ed0-a9f06a80e2ec None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.280995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.306769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02085d9-40fd-4c4e-8789-70c36464ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.307416 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02085d9-40fd-4c4e-8789-70c36464ce71 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.307697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02085d9-40fd-4c4e-8789-70c36464ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.307974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02085d9-40fd-4c4e-8789-70c36464ce71 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.309114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02085d9-40fd-4c4e-8789-70c36464ce71 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:23.310600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02085d9-40fd-4c4e-8789-70c36464ce71 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:23.312190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 38/79] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:23.312952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02085d9-40fd-4c4e-8789-70c36464ce71 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.350590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 42/80] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:23.351443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ead960-570e-41c5-969f-3e0740855506 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.400335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.417704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02085d9-40fd-4c4e-8789-70c36464ce71 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.450942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f707db0-3647-4923-8586-f8221dc4913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.451581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707db0-3647-4923-8586-f8221dc4913a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.451864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707db0-3647-4923-8586-f8221dc4913a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.452137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f707db0-3647-4923-8586-f8221dc4913a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.453261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f707db0-3647-4923-8586-f8221dc4913a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:23.454745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f707db0-3647-4923-8586-f8221dc4913a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:23.454932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ead960-570e-41c5-969f-3e0740855506 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.456316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 39/81] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:23.457127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f707db0-3647-4923-8586-f8221dc4913a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.489644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de2a12-6582-4e50-a306-cc0a99e02cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.490280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de2a12-6582-4e50-a306-cc0a99e02cec None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.490566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de2a12-6582-4e50-a306-cc0a99e02cec None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.490852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de2a12-6582-4e50-a306-cc0a99e02cec None admin] PATH_INFO: `/v3/users/802225de4e5b4f0395304da25f9b41c5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.492019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de2a12-6582-4e50-a306-cc0a99e02cec None admin] RBAC: Authorizing `identity:get_user(user_id=802225de4e5b4f0395304da25f9b41c5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:23.493761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de2a12-6582-4e50-a306-cc0a99e02cec None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:23.495396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 43/82] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/users/802225de4e5b4f0395304da25f9b41c5 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:23.496172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de2a12-6582-4e50-a306-cc0a99e02cec None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.501607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.558346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f707db0-3647-4923-8586-f8221dc4913a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.592570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123ac6b-1396-4214-b5ec-44a002232909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.593201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123ac6b-1396-4214-b5ec-44a002232909 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.593521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123ac6b-1396-4214-b5ec-44a002232909 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.593800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123ac6b-1396-4214-b5ec-44a002232909 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.600446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de2a12-6582-4e50-a306-cc0a99e02cec None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.603759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123ac6b-1396-4214-b5ec-44a002232909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9123ac6b-1396-4214-b5ec-44a002232909 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:23.608602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:23.609742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:23.610505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 40/83] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:23.611121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123ac6b-1396-4214-b5ec-44a002232909 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.625264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.635776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22116e1-a205-4246-b745-928fdcb05302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.636395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22116e1-a205-4246-b745-928fdcb05302 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.636676 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22116e1-a205-4246-b745-928fdcb05302 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.636955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22116e1-a205-4246-b745-928fdcb05302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.703871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22116e1-a205-4246-b745-928fdcb05302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:23.705272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22116e1-a205-4246-b745-928fdcb05302 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:23.707988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.712171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123ac6b-1396-4214-b5ec-44a002232909 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.745067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb5102-9199-4099-85a5-244671e97549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.745723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5102-9199-4099-85a5-244671e97549 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.746021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5102-9199-4099-85a5-244671e97549 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.746282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb5102-9199-4099-85a5-244671e97549 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.747405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb5102-9199-4099-85a5-244671e97549 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:23.748832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb5102-9199-4099-85a5-244671e97549 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:23.750476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 41/84] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:23.751738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb5102-9199-4099-85a5-244671e97549 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.809218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 44/85] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:23.810097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22116e1-a205-4246-b745-928fdcb05302 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.836890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.857044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb5102-9199-4099-85a5-244671e97549 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.890021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813a967-cd60-463b-8688-f9e117acdb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.890624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813a967-cd60-463b-8688-f9e117acdb2b None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.890910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813a967-cd60-463b-8688-f9e117acdb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.891688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813a967-cd60-463b-8688-f9e117acdb2b None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:23.892367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813a967-cd60-463b-8688-f9e117acdb2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:23.893859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813a967-cd60-463b-8688-f9e117acdb2b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:23.908218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22116e1-a205-4246-b745-928fdcb05302 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:23.912267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:23.915115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 42/86] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 00:59:23 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:23.915919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813a967-cd60-463b-8688-f9e117acdb2b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:23.957877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba383b-a550-4d45-a153-4fc872da31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:23.958423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba383b-a550-4d45-a153-4fc872da31f1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:23.958711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba383b-a550-4d45-a153-4fc872da31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:23.958990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba383b-a550-4d45-a153-4fc872da31f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.032611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813a967-cd60-463b-8688-f9e117acdb2b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:24.035477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba383b-a550-4d45-a153-4fc872da31f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.036994 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba383b-a550-4d45-a153-4fc872da31f1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.073427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:24.074091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:24.074375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:24.074651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.075334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:24.075636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.077190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.080544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:24.093573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 43/87] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:24.094829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:24.172113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 45/88] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:24.173553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba383b-a550-4d45-a153-4fc872da31f1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:24.177193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:24.213186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc562-b122-4e1b-8b95-4d50495424b0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:24.258676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:24.259303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:24.259590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:24.259965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.260720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] RBAC: Adding query filter params (role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=e24b490d9d7146659455e535a333fad2, user.id=1526aa7734774ccf820a8c5a4d4f9a40) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:24.261034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.262527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.271055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 44/89] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:24 2022] GET /identity/v3/role_assignments?user.id=1526aa7734774ccf820a8c5a4d4f9a40&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=193a2ccbf16642a0af3edc128493946e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:24.271764 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:24.307271 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba383b-a550-4d45-a153-4fc872da31f1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:24.365313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94875f7-fda1-49c6-a647-a74ae0fcc446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:24.367725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94875f7-fda1-49c6-a647-a74ae0fcc446 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:24.369611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94875f7-fda1-49c6-a647-a74ae0fcc446 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:24.370061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94875f7-fda1-49c6-a647-a74ae0fcc446 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.371273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:24.373162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94875f7-fda1-49c6-a647-a74ae0fcc446 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.377648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94875f7-fda1-49c6-a647-a74ae0fcc446 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.379931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:24 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:24.383658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94875f7-fda1-49c6-a647-a74ae0fcc446 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:24.471363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:24.471540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f123e0-d3d8-491c-b1b1-47f14cccfe91 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:24.507949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94875f7-fda1-49c6-a647-a74ae0fcc446 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:24.538539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e032935-269c-4c63-b921-e3aa556cb730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:24.539683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032935-269c-4c63-b921-e3aa556cb730 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:24.541656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032935-269c-4c63-b921-e3aa556cb730 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:24.542132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e032935-269c-4c63-b921-e3aa556cb730 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.543691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e032935-269c-4c63-b921-e3aa556cb730 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.545761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e032935-269c-4c63-b921-e3aa556cb730 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.548900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:24 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:24.549881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e032935-269c-4c63-b921-e3aa556cb730 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:24.552799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9580-eb89-47f0-8a9c-5d91b619ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:24.553472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9580-eb89-47f0-8a9c-5d91b619ce43 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:24.553762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9580-eb89-47f0-8a9c-5d91b619ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:24.554195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9580-eb89-47f0-8a9c-5d91b619ce43 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.555698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9580-eb89-47f0-8a9c-5d91b619ce43 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.556810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9580-eb89-47f0-8a9c-5d91b619ce43 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.559788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:24 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:24.559788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9580-eb89-47f0-8a9c-5d91b619ce43 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:24.700805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e032935-269c-4c63-b921-e3aa556cb730 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:24.751820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:24.752409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:24.752659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:24.752893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.753691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] RBAC: Adding query filter params (role.id=72b0245082944533beab3a422c3c640a, scope.project.id=e24b490d9d7146659455e535a333fad2, user.id=1526aa7734774ccf820a8c5a4d4f9a40) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:24.754004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.755450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.758481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:24.761357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:24 2022] GET /identity/v3/role_assignments?user.id=1526aa7734774ccf820a8c5a4d4f9a40&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=72b0245082944533beab3a422c3c640a => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:24.766519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:24.770058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9580-eb89-47f0-8a9c-5d91b619ce43 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:24.818616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0c55b-2b25-43dd-8d0d-821ea9a3dd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:24.819239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0c55b-2b25-43dd-8d0d-821ea9a3dd95 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:24.819524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0c55b-2b25-43dd-8d0d-821ea9a3dd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:24.819799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0c55b-2b25-43dd-8d0d-821ea9a3dd95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.833260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:24.921865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbf1b9-d2d2-4d98-b818-bb85aeee23e5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:24.970639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0c55b-2b25-43dd-8d0d-821ea9a3dd95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.972434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0c55b-2b25-43dd-8d0d-821ea9a3dd95 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.972985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:24.973638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:24.973929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:24.974204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:24.974950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=e24b490d9d7146659455e535a333fad2, user.id=802225de4e5b4f0395304da25f9b41c5) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:24.975328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:24.976704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:24.987244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 47/94] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:24 2022] GET /identity/v3/role_assignments?user.id=802225de4e5b4f0395304da25f9b41c5&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=c182619b007b495f912901d866e751e1 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:25.125050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 48/95] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:25.130989 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:25.214890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:25.280319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4fb0d-a200-403e-8f48-6acb0fd809c4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:25.331483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15534c75-bb73-4845-86bf-bee06cd28021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:25.332548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534c75-bb73-4845-86bf-bee06cd28021 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:25.333037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534c75-bb73-4845-86bf-bee06cd28021 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:25.333545 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534c75-bb73-4845-86bf-bee06cd28021 None admin] PATH_INFO: `/v3/projects/85bcc30405244f2187c8f87494089039` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:25.338324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15534c75-bb73-4845-86bf-bee06cd28021 None admin] RBAC: Authorizing `identity:get_project(project_id=85bcc30405244f2187c8f87494089039)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:25.340339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15534c75-bb73-4845-86bf-bee06cd28021 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:25.342805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:25 2022] GET /identity/v3/projects/85bcc30405244f2187c8f87494089039 => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:25.348590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0c55b-2b25-43dd-8d0d-821ea9a3dd95 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:25.411284 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:25.481908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0c55b-2b25-43dd-8d0d-821ea9a3dd95 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:25.534848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bdd39-3a67-4dc9-835b-e448773887c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:25.535470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bdd39-3a67-4dc9-835b-e448773887c5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:25.535757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bdd39-3a67-4dc9-835b-e448773887c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:25.536037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bdd39-3a67-4dc9-835b-e448773887c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:25.536930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bdd39-3a67-4dc9-835b-e448773887c5 None admin] RBAC: Adding query filter params (role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=85bcc30405244f2187c8f87494089039, user.id=1526aa7734774ccf820a8c5a4d4f9a40) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:25.537253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bdd39-3a67-4dc9-835b-e448773887c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:25.538780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bdd39-3a67-4dc9-835b-e448773887c5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:25.550239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 49/97] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:25 2022] GET /identity/v3/role_assignments?user.id=1526aa7734774ccf820a8c5a4d4f9a40&scope.project.id=85bcc30405244f2187c8f87494089039&role.id=193a2ccbf16642a0af3edc128493946e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:27.044072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49f96-fad2-4b78-95cd-4dbdc21e00f7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:27.044072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49f96-fad2-4b78-95cd-4dbdc21e00f7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:27.044072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef49f96-fad2-4b78-95cd-4dbdc21e00f7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:27.044072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 49/98] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:27.050575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4ba2-d507-417f-b27a-a7837632a6e3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:27.050980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4ba2-d507-417f-b27a-a7837632a6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:27.051174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4ba2-d507-417f-b27a-a7837632a6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:27.077820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-92fa4ba2-d507-417f-b27a-a7837632a6e3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:27.079601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-92fa4ba2-d507-417f-b27a-a7837632a6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:27.185360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 50/99] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:27.292962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82923e-fa46-4ad5-9490-15e8e52e37c5 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:27.293290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82923e-fa46-4ad5-9490-15e8e52e37c5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:27.293581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82923e-fa46-4ad5-9490-15e8e52e37c5 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:27.295092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 50/100] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:27.308678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54d80-8239-4a40-a745-dfb9d6bc6c14 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:27.309020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54d80-8239-4a40-a745-dfb9d6bc6c14 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:27.309309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54d80-8239-4a40-a745-dfb9d6bc6c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:27.334981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d1e54d80-8239-4a40-a745-dfb9d6bc6c14 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:27.336245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d1e54d80-8239-4a40-a745-dfb9d6bc6c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:27.370479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:27.419161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 51/101] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:27.543352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82923e-fa46-4ad5-9490-15e8e52e37c5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:27.694309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82923e-fa46-4ad5-9490-15e8e52e37c5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:27.721356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:27.740082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a09e-8f92-4e87-a77e-26cf5039a880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:27.740740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a09e-8f92-4e87-a77e-26cf5039a880 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:27.741028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a09e-8f92-4e87-a77e-26cf5039a880 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:27.741309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a09e-8f92-4e87-a77e-26cf5039a880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:27.742826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0a09e-8f92-4e87-a77e-26cf5039a880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:27.746732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0a09e-8f92-4e87-a77e-26cf5039a880 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:27.753710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 51/102] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:27.757215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54d80-8239-4a40-a745-dfb9d6bc6c14 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:27.864999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c534-f142-48bf-bb70-29b1cce6e7c5 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:27.865280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c534-f142-48bf-bb70-29b1cce6e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:27.865658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c534-f142-48bf-bb70-29b1cce6e7c5 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:27.866995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 52/103] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:27.873500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc7ded-cd2f-4a93-8432-8abc3c3ec041 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:27.873792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc7ded-cd2f-4a93-8432-8abc3c3ec041 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:27.874070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc7ded-cd2f-4a93-8432-8abc3c3ec041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:27.906485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9fbc7ded-cd2f-4a93-8432-8abc3c3ec041 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:27.909567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9fbc7ded-cd2f-4a93-8432-8abc3c3ec041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:27.929098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54d80-8239-4a40-a745-dfb9d6bc6c14 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:28.020065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88466b01-01d2-4e78-931f-6f434f04f65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:28.020622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466b01-01d2-4e78-931f-6f434f04f65d None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.020913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466b01-01d2-4e78-931f-6f434f04f65d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.021234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466b01-01d2-4e78-931f-6f434f04f65d None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.026205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88466b01-01d2-4e78-931f-6f434f04f65d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:28.028775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88466b01-01d2-4e78-931f-6f434f04f65d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:28.087139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 53/104] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:28.088925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc7ded-cd2f-4a93-8432-8abc3c3ec041 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:28.101569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 52/105] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 00:59:27 2022] POST /identity/v3/projects => generated 302 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:28.177531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278eea1-9145-4408-9a4e-91013bfc651e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.178163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278eea1-9145-4408-9a4e-91013bfc651e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.178670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278eea1-9145-4408-9a4e-91013bfc651e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.180328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 53/106] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:28.191067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413704-f4c7-456d-9fbf-85c6df1142f6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.191738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413704-f4c7-456d-9fbf-85c6df1142f6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.192271 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413704-f4c7-456d-9fbf-85c6df1142f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.217780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ba413704-f4c7-456d-9fbf-85c6df1142f6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:28.220120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ba413704-f4c7-456d-9fbf-85c6df1142f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:28.239561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:28.299806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc7ded-cd2f-4a93-8432-8abc3c3ec041 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:28.341907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:28.349445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:28.352536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036f98c-d241-47d9-925c-238898e36e26 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.352835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036f98c-d241-47d9-925c-238898e36e26 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.353183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036f98c-d241-47d9-925c-238898e36e26 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.354490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 55/108] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:28.359121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe7016-04c3-4fe0-a3e1-42c88e2d6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:28.360413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f6c8-82d1-49a5-82a0-6f9cb5dadc9e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.360704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f6c8-82d1-49a5-82a0-6f9cb5dadc9e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.360983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f6c8-82d1-49a5-82a0-6f9cb5dadc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.361234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7016-04c3-4fe0-a3e1-42c88e2d6e0c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.361782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7016-04c3-4fe0-a3e1-42c88e2d6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.362256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7016-04c3-4fe0-a3e1-42c88e2d6e0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.375929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe7016-04c3-4fe0-a3e1-42c88e2d6e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f0fe7016-04c3-4fe0-a3e1-42c88e2d6e0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:28.381259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:28.382127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:28.382856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:28.384898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b854f6c8-82d1-49a5-82a0-6f9cb5dadc9e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:28.385452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 54/109] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:28.389209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b854f6c8-82d1-49a5-82a0-6f9cb5dadc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:28.392226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe7016-04c3-4fe0-a3e1-42c88e2d6e0c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:28.467293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 56/110] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:28.536146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe7016-04c3-4fe0-a3e1-42c88e2d6e0c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:28.588524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:28.589056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.589337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.589640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.590519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:28.590823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:28.592210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:28.605152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 55/111] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:28.611137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854f6c8-82d1-49a5-82a0-6f9cb5dadc9e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:28.623624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:28.712905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:28.744385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:28.791556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854f6c8-82d1-49a5-82a0-6f9cb5dadc9e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:28.808668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a822821-a239-4871-9811-167f0aa8c144 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:28.856305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f73e6a-fb21-420d-a04b-680a192cff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:28.856865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f73e6a-fb21-420d-a04b-680a192cff84 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.857146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f73e6a-fb21-420d-a04b-680a192cff84 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.857435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f73e6a-fb21-420d-a04b-680a192cff84 None admin] PATH_INFO: `/v3/users/f5c2e4004db04004a045914f051ca755` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.869891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a8f5c-c68b-49e1-a2e0-5b3f2e778b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:28.870551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8f5c-c68b-49e1-a2e0-5b3f2e778b35 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:28.870842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8f5c-c68b-49e1-a2e0-5b3f2e778b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:28.871130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8f5c-c68b-49e1-a2e0-5b3f2e778b35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:28.878149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f73e6a-fb21-420d-a04b-680a192cff84 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c2e4004db04004a045914f051ca755)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:28.879787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f73e6a-fb21-420d-a04b-680a192cff84 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:28.881666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 57/112] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:28 2022] GET /identity/v3/users/f5c2e4004db04004a045914f051ca755 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:28.882598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f73e6a-fb21-420d-a04b-680a192cff84 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:28.883090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a8f5c-c68b-49e1-a2e0-5b3f2e778b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1d9a8f5c-c68b-49e1-a2e0-5b3f2e778b35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:28.888822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:28.889707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 56/113] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:28.890959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a8f5c-c68b-49e1-a2e0-5b3f2e778b35 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.009589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f73e6a-fb21-420d-a04b-680a192cff84 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.036332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a8f5c-c68b-49e1-a2e0-5b3f2e778b35 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.046038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:29.046319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c10d2d-d0b6-45f5-9179-6ebfff0a96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.046969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10d2d-d0b6-45f5-9179-6ebfff0a96eb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.047765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10d2d-d0b6-45f5-9179-6ebfff0a96eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.048099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10d2d-d0b6-45f5-9179-6ebfff0a96eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.050764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:29.062747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c10d2d-d0b6-45f5-9179-6ebfff0a96eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a5c10d2d-d0b6-45f5-9179-6ebfff0a96eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:29.068655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:29.069507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:29.070398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 58/114] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 00:59:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:29.071010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c10d2d-d0b6-45f5-9179-6ebfff0a96eb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.087740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0369b0-7340-4f7b-ad09-2dc3d3f56812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.088643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0369b0-7340-4f7b-ad09-2dc3d3f56812 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.088934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0369b0-7340-4f7b-ad09-2dc3d3f56812 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.089605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0369b0-7340-4f7b-ad09-2dc3d3f56812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.102264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0369b0-7340-4f7b-ad09-2dc3d3f56812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ad0369b0-7340-4f7b-ad09-2dc3d3f56812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:29.107686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:29.108530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:29.109306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 57/115] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:29.110541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0369b0-7340-4f7b-ad09-2dc3d3f56812 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.188891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c10d2d-d0b6-45f5-9179-6ebfff0a96eb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.222127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0369b0-7340-4f7b-ad09-2dc3d3f56812 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.229915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d667fa-6b6d-43c3-b977-410da71eb965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.230717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d667fa-6b6d-43c3-b977-410da71eb965 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.231617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d667fa-6b6d-43c3-b977-410da71eb965 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.232083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d667fa-6b6d-43c3-b977-410da71eb965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.258430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.259050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.259329 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.259601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.260271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:29.260578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:29.262011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:29.272818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 58/116] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:29.273845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.307109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:29.317319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:29.324966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d667fa-6b6d-43c3-b977-410da71eb965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:29.326483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d667fa-6b6d-43c3-b977-410da71eb965 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:29.384686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a1eae-4cde-4939-87d8-dbe033821425 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.418993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccd549-abb6-4490-954f-6f174d29d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.419604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccd549-abb6-4490-954f-6f174d29d44d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.419889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccd549-abb6-4490-954f-6f174d29d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.420169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccd549-abb6-4490-954f-6f174d29d44d None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.420838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccd549-abb6-4490-954f-6f174d29d44d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:29.421148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccd549-abb6-4490-954f-6f174d29d44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:29.422661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccd549-abb6-4490-954f-6f174d29d44d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:29.430635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 59/117] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:29.434897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ca7c6-dba1-48b2-ac24-4885c02377a9 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.435477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ca7c6-dba1-48b2-ac24-4885c02377a9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.435759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ca7c6-dba1-48b2-ac24-4885c02377a9 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.437029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 60/118] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:29.438721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ca7c6-dba1-48b2-ac24-4885c02377a9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.443942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 59/119] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:29.446121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d667fa-6b6d-43c3-b977-410da71eb965 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.544223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:29.557103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ca7c6-dba1-48b2-ac24-4885c02377a9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.558171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:29.565732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d667fa-6b6d-43c3-b977-410da71eb965 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.591597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.592209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.592495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.592997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.593526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:29.593946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:29.595862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:29.601798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e7823-7117-4f38-a172-cb52615712f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.602432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e7823-7117-4f38-a172-cb52615712f3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.602720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e7823-7117-4f38-a172-cb52615712f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.602999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e7823-7117-4f38-a172-cb52615712f3 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.604141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e7823-7117-4f38-a172-cb52615712f3 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:29.613554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 61/120] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:29.613554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.613770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e7823-7117-4f38-a172-cb52615712f3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:29.613770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 60/121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:29.613770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103503da-d283-4581-ad00-c6d47a9a2147 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.613770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103503da-d283-4581-ad00-c6d47a9a2147 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.613770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103503da-d283-4581-ad00-c6d47a9a2147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.628847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-103503da-d283-4581-ad00-c6d47a9a2147 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:29.630125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-103503da-d283-4581-ad00-c6d47a9a2147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:29.705725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 61/122] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:29.714282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103503da-d283-4581-ad00-c6d47a9a2147 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.717308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa305dd-d008-48a6-9aa9-80cbd0dfafba None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.754782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fee2b-f711-4214-9ecf-9470252e4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.755343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fee2b-f711-4214-9ecf-9470252e4630 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.755632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fee2b-f711-4214-9ecf-9470252e4630 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.755912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fee2b-f711-4214-9ecf-9470252e4630 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.757064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fee2b-f711-4214-9ecf-9470252e4630 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:29.758669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fee2b-f711-4214-9ecf-9470252e4630 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:29.760428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 62/123] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:29.766152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fee2b-f711-4214-9ecf-9470252e4630 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.794099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:29.841810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:29.854291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103503da-d283-4581-ad00-c6d47a9a2147 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.883101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fee2b-f711-4214-9ecf-9470252e4630 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:29.901376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cdbd9-2292-4614-a9f0-1dad2f8b6d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.902561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdbd9-2292-4614-a9f0-1dad2f8b6d15 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.903040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdbd9-2292-4614-a9f0-1dad2f8b6d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.903862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cdbd9-2292-4614-a9f0-1dad2f8b6d15 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.905206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cdbd9-2292-4614-a9f0-1dad2f8b6d15 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:29.908056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cdbd9-2292-4614-a9f0-1dad2f8b6d15 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:29.910669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 62/124] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:29.912027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cdbd9-2292-4614-a9f0-1dad2f8b6d15 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:29.921896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568879-6024-4606-8a62-36df78b0ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:29.922656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568879-6024-4606-8a62-36df78b0ce0e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:29.923012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568879-6024-4606-8a62-36df78b0ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:29.923383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568879-6024-4606-8a62-36df78b0ce0e None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:29.924689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c568879-6024-4606-8a62-36df78b0ce0e None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:29.926255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c568879-6024-4606-8a62-36df78b0ce0e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:29.928075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 63/125] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:29.932723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568879-6024-4606-8a62-36df78b0ce0e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.030314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:30.038597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cdbd9-2292-4614-a9f0-1dad2f8b6d15 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.043014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568879-6024-4606-8a62-36df78b0ce0e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.074565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c266aa8-d011-428d-8eb1-bc3faf37cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:30.075200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266aa8-d011-428d-8eb1-bc3faf37cabe None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:30.075516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266aa8-d011-428d-8eb1-bc3faf37cabe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:30.075781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266aa8-d011-428d-8eb1-bc3faf37cabe None admin] PATH_INFO: `/v3/users/802225de4e5b4f0395304da25f9b41c5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:30.076889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c266aa8-d011-428d-8eb1-bc3faf37cabe None admin] RBAC: Authorizing `identity:get_user(user_id=802225de4e5b4f0395304da25f9b41c5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:30.078362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c266aa8-d011-428d-8eb1-bc3faf37cabe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:30.080213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 63/126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/users/802225de4e5b4f0395304da25f9b41c5 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:30.080475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86781846-389b-4d4a-8755-8f142fcb18b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:30.080768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c266aa8-d011-428d-8eb1-bc3faf37cabe None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.081393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86781846-389b-4d4a-8755-8f142fcb18b2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:30.081706 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86781846-389b-4d4a-8755-8f142fcb18b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:30.081984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86781846-389b-4d4a-8755-8f142fcb18b2 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:30.085482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86781846-389b-4d4a-8755-8f142fcb18b2 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:30.086937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86781846-389b-4d4a-8755-8f142fcb18b2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:30.088684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 64/127] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:29 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:30.089322 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86781846-389b-4d4a-8755-8f142fcb18b2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.117683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:30.199587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86781846-389b-4d4a-8755-8f142fcb18b2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.199781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c266aa8-d011-428d-8eb1-bc3faf37cabe None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.236272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7ea25-1050-4649-8fd7-8f8cb8e0b39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:30.236713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:30.237037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7ea25-1050-4649-8fd7-8f8cb8e0b39d None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:30.237217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7ea25-1050-4649-8fd7-8f8cb8e0b39d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:30.237326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:30.237520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7ea25-1050-4649-8fd7-8f8cb8e0b39d None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2/users/1526aa7734774ccf820a8c5a4d4f9a40/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:30.237629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:30.237889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:30.238620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] RBAC: Adding query filter params (role.id=825bce4bc5ec40e8ba620d6514237e48, scope.project.id=e24b490d9d7146659455e535a333fad2, user.id=f5c2e4004db04004a045914f051ca755) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:30.238937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:30.239496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7ea25-1050-4649-8fd7-8f8cb8e0b39d None admin] RBAC: Authorizing `identity:create_grant(project_id=e24b490d9d7146659455e535a333fad2, user_id=1526aa7734774ccf820a8c5a4d4f9a40, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:30.240416 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:30.240929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7ea25-1050-4649-8fd7-8f8cb8e0b39d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:30.246245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 64/128] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:30 2022] GET /identity/v3/role_assignments?user.id=f5c2e4004db04004a045914f051ca755&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=825bce4bc5ec40e8ba620d6514237e48 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:30.247218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.271840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 65/129] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:30 2022] PUT /identity/v3/projects/e24b490d9d7146659455e535a333fad2/users/1526aa7734774ccf820a8c5a4d4f9a40/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:30.273148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7ea25-1050-4649-8fd7-8f8cb8e0b39d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.318001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:30.450025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:30.460583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d79b55-8c0b-457a-805e-626b1da89bfd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.462326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7ea25-1050-4649-8fd7-8f8cb8e0b39d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.514569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0f746-8f41-4733-92ed-58c83a0c4bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:30.515336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0f746-8f41-4733-92ed-58c83a0c4bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:30.515628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0f746-8f41-4733-92ed-58c83a0c4bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:30.515909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0f746-8f41-4733-92ed-58c83a0c4bf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:30.523188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232def8-cd6f-4922-8d5c-c8e45a0f9aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:30.524169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232def8-cd6f-4922-8d5c-c8e45a0f9aec None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:30.524645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232def8-cd6f-4922-8d5c-c8e45a0f9aec None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:30.525110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232def8-cd6f-4922-8d5c-c8e45a0f9aec None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:30.531210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0f746-8f41-4733-92ed-58c83a0c4bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:30.533605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232def8-cd6f-4922-8d5c-c8e45a0f9aec None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:30.535310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232def8-cd6f-4922-8d5c-c8e45a0f9aec None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-67d0f746-8f41-4733-92ed-58c83a0c4bf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:30.536113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:30.536941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:30.537731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:30.538344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0f746-8f41-4733-92ed-58c83a0c4bf9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.546915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:30 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:30.548102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232def8-cd6f-4922-8d5c-c8e45a0f9aec None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.671449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:30.675488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0f746-8f41-4733-92ed-58c83a0c4bf9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.695362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232def8-cd6f-4922-8d5c-c8e45a0f9aec None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.728387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bcf92-a045-483d-aa83-e6a6000ed6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:30.729850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bcf92-a045-483d-aa83-e6a6000ed6ca None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:30.730412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bcf92-a045-483d-aa83-e6a6000ed6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:30.730920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bcf92-a045-483d-aa83-e6a6000ed6ca None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2/users/1526aa7734774ccf820a8c5a4d4f9a40/roles/72b0245082944533beab3a422c3c640a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:30.733733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bcf92-a045-483d-aa83-e6a6000ed6ca None admin] RBAC: Authorizing `identity:create_grant(project_id=e24b490d9d7146659455e535a333fad2, user_id=1526aa7734774ccf820a8c5a4d4f9a40, role_id=72b0245082944533beab3a422c3c640a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:30.734147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:30.734907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:30.735291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:30.735671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:30.736034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bcf92-a045-483d-aa83-e6a6000ed6ca None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:30.736540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:30.736967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:30.738577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:30.751067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 67/132] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:30.751930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.775482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 66/133] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:30 2022] PUT /identity/v3/projects/e24b490d9d7146659455e535a333fad2/users/1526aa7734774ccf820a8c5a4d4f9a40/roles/72b0245082944533beab3a422c3c640a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:30.778998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bcf92-a045-483d-aa83-e6a6000ed6ca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:30.807960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:30.966252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bcf92-a045-483d-aa83-e6a6000ed6ca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:30.979868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9128294-46c3-47d6-99a1-7f22984bbc4b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:31.011936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448a652-dbdc-4ce8-90b7-d8429abf52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:31.013212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a652-dbdc-4ce8-90b7-d8429abf52c6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:31.013711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a652-dbdc-4ce8-90b7-d8429abf52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:31.014182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a652-dbdc-4ce8-90b7-d8429abf52c6 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:31.015562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448a652-dbdc-4ce8-90b7-d8429abf52c6 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:31.017882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448a652-dbdc-4ce8-90b7-d8429abf52c6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:31.019778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 67/134] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:30 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:31.021170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978aff1-e125-4153-96d8-36ea6e67494a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:31.021681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978aff1-e125-4153-96d8-36ea6e67494a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:31.022154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978aff1-e125-4153-96d8-36ea6e67494a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:31.023616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 68/135] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:31.027130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978aff1-e125-4153-96d8-36ea6e67494a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:31.044400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b531663-a485-457f-a129-52ca2c1d6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:31.045097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531663-a485-457f-a129-52ca2c1d6fce None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:31.045412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531663-a485-457f-a129-52ca2c1d6fce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:31.045798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b531663-a485-457f-a129-52ca2c1d6fce None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2/users/802225de4e5b4f0395304da25f9b41c5/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:31.048796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b531663-a485-457f-a129-52ca2c1d6fce None admin] RBAC: Authorizing `identity:create_grant(project_id=e24b490d9d7146659455e535a333fad2, user_id=802225de4e5b4f0395304da25f9b41c5, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:31.050541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b531663-a485-457f-a129-52ca2c1d6fce None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:31.069479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 68/136] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:30 2022] PUT /identity/v3/projects/e24b490d9d7146659455e535a333fad2/users/802225de4e5b4f0395304da25f9b41c5/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:31.071077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661f30-1ab1-4f27-8a4e-170efc3c6d57 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:31.071561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661f30-1ab1-4f27-8a4e-170efc3c6d57 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:31.072127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661f30-1ab1-4f27-8a4e-170efc3c6d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:31.089807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:31.094719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-80661f30-1ab1-4f27-8a4e-170efc3c6d57 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:31.096127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-80661f30-1ab1-4f27-8a4e-170efc3c6d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:31.149590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:31.202264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978aff1-e125-4153-96d8-36ea6e67494a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:31.233747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 69/137] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:31.273333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86e9ec-3170-4117-a404-638761830402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:31.274356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86e9ec-3170-4117-a404-638761830402 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:31.274835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86e9ec-3170-4117-a404-638761830402 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:31.275306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86e9ec-3170-4117-a404-638761830402 None admin] PATH_INFO: `/v3/projects/85bcc30405244f2187c8f87494089039` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:31.276648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86e9ec-3170-4117-a404-638761830402 None admin] RBAC: Authorizing `identity:get_project(project_id=85bcc30405244f2187c8f87494089039)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:31.278380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86e9ec-3170-4117-a404-638761830402 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:31.287470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 69/138] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:31 2022] GET /identity/v3/projects/85bcc30405244f2187c8f87494089039 => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:31.293433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661f30-1ab1-4f27-8a4e-170efc3c6d57 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:31.418301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661f30-1ab1-4f27-8a4e-170efc3c6d57 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:31.471587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c46f9-5af5-4e00-8f14-f278139463d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:31.471587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c46f9-5af5-4e00-8f14-f278139463d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:31.471841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c46f9-5af5-4e00-8f14-f278139463d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:31.472063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c46f9-5af5-4e00-8f14-f278139463d2 None admin] PATH_INFO: `/v3/projects/85bcc30405244f2187c8f87494089039/users/1526aa7734774ccf820a8c5a4d4f9a40/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:31.474023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c46f9-5af5-4e00-8f14-f278139463d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=85bcc30405244f2187c8f87494089039, user_id=1526aa7734774ccf820a8c5a4d4f9a40, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:31.475466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c46f9-5af5-4e00-8f14-f278139463d2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:31.479169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:31.496444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 70/139] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:31 2022] PUT /identity/v3/projects/85bcc30405244f2187c8f87494089039/users/1526aa7734774ccf820a8c5a4d4f9a40/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:31.706950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86e9ec-3170-4117-a404-638761830402 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:31.835700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86e9ec-3170-4117-a404-638761830402 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:31.879942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fd671-6182-475f-8181-b489ee33d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:31.880813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fd671-6182-475f-8181-b489ee33d020 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:31.881273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fd671-6182-475f-8181-b489ee33d020 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:31.881707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fd671-6182-475f-8181-b489ee33d020 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:31.882973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fd671-6182-475f-8181-b489ee33d020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:31.884577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fd671-6182-475f-8181-b489ee33d020 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:31.890577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 70/140] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:31.897151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c46f9-5af5-4e00-8f14-f278139463d2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:32.030568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c46f9-5af5-4e00-8f14-f278139463d2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:32.073284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584099c-a920-4c6a-a943-6711c6d1bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:32.073946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584099c-a920-4c6a-a943-6711c6d1bbec None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:32.074229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584099c-a920-4c6a-a943-6711c6d1bbec None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:32.074510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584099c-a920-4c6a-a943-6711c6d1bbec None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:32.075190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584099c-a920-4c6a-a943-6711c6d1bbec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:32.076647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584099c-a920-4c6a-a943-6711c6d1bbec None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:32.115279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 71/141] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 00:59:31 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:33.355582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29366-030f-4642-a310-25f411ada724 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:33.356624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29366-030f-4642-a310-25f411ada724 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:33.357106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29366-030f-4642-a310-25f411ada724 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:33.358710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 71/142] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:33.382061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66de2c-d34f-458e-a7c6-1a57e8fc510c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:33.382530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66de2c-d34f-458e-a7c6-1a57e8fc510c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:33.382601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66de2c-d34f-458e-a7c6-1a57e8fc510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:33.407549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fa66de2c-d34f-458e-a7c6-1a57e8fc510c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:33.408752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fa66de2c-d34f-458e-a7c6-1a57e8fc510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:33.470681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:33.499811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 72/143] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:33.727729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005112-9d2c-4acf-97c7-6be2291ff289 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:33.728097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005112-9d2c-4acf-97c7-6be2291ff289 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:33.728290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005112-9d2c-4acf-97c7-6be2291ff289 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:33.729916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 72/144] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:33.735583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7143266-6a91-4acb-8fee-6b75ef072ab9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:33.735872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7143266-6a91-4acb-8fee-6b75ef072ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:33.736150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7143266-6a91-4acb-8fee-6b75ef072ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:33.759611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d7143266-6a91-4acb-8fee-6b75ef072ab9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:33.760812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d7143266-6a91-4acb-8fee-6b75ef072ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:33.843364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 73/145] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:33.916166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb005112-9d2c-4acf-97c7-6be2291ff289 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:33.938826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:34.038607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb005112-9d2c-4acf-97c7-6be2291ff289 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:34.080462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480667-730f-4e25-9c4c-a548a92cc0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:34.081104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480667-730f-4e25-9c4c-a548a92cc0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.081385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480667-730f-4e25-9c4c-a548a92cc0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.081688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480667-730f-4e25-9c4c-a548a92cc0e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.095399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f480667-730f-4e25-9c4c-a548a92cc0e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5f480667-730f-4e25-9c4c-a548a92cc0e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:34.100402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:34.101251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:34.102047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 73/146] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:34.107671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7143266-6a91-4acb-8fee-6b75ef072ab9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:34.237962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7143266-6a91-4acb-8fee-6b75ef072ab9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:34.257867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:34.288223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee17889-4484-44b1-b3a9-5a5ae0be1018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:34.288947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17889-4484-44b1-b3a9-5a5ae0be1018 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.289182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17889-4484-44b1-b3a9-5a5ae0be1018 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.289477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17889-4484-44b1-b3a9-5a5ae0be1018 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.290180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee17889-4484-44b1-b3a9-5a5ae0be1018 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:34.290488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee17889-4484-44b1-b3a9-5a5ae0be1018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:34.291981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee17889-4484-44b1-b3a9-5a5ae0be1018 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:34.307030 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 74/147] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:34.313378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480667-730f-4e25-9c4c-a548a92cc0e2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:34.374133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd9783-9661-4e45-a735-790837eebf88 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.375098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd9783-9661-4e45-a735-790837eebf88 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.375677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd9783-9661-4e45-a735-790837eebf88 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.378024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 75/148] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:34.383429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175392e-a737-4cde-b5ab-0e2ff2278af5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.384368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175392e-a737-4cde-b5ab-0e2ff2278af5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.384829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175392e-a737-4cde-b5ab-0e2ff2278af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.411053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3175392e-a737-4cde-b5ab-0e2ff2278af5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:34.412614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3175392e-a737-4cde-b5ab-0e2ff2278af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:34.417177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:34.444828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480667-730f-4e25-9c4c-a548a92cc0e2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:34.482814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76234b78-a254-4aee-822b-f1d527321e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:34.483812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234b78-a254-4aee-822b-f1d527321e61 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.484276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234b78-a254-4aee-822b-f1d527321e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.485286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234b78-a254-4aee-822b-f1d527321e61 None admin] PATH_INFO: `/v3/users/f5c2e4004db04004a045914f051ca755` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.486739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76234b78-a254-4aee-822b-f1d527321e61 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c2e4004db04004a045914f051ca755)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:34.488360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76234b78-a254-4aee-822b-f1d527321e61 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:34.490679 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 74/149] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:34 2022] GET /identity/v3/users/f5c2e4004db04004a045914f051ca755 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:34.491624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76234b78-a254-4aee-822b-f1d527321e61 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:34.528783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 76/150] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:34.530435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d0ba6-8a73-4b17-87b6-35bc360b98eb None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.530916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d0ba6-8a73-4b17-87b6-35bc360b98eb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.531406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d0ba6-8a73-4b17-87b6-35bc360b98eb None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.533555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 77/151] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:34.534497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d0ba6-8a73-4b17-87b6-35bc360b98eb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:34.664709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76234b78-a254-4aee-822b-f1d527321e61 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:34.700714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34ea17-f26a-48a6-bfd1-00478f2ecf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:34.701374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ea17-f26a-48a6-bfd1-00478f2ecf45 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.701687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ea17-f26a-48a6-bfd1-00478f2ecf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.701964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34ea17-f26a-48a6-bfd1-00478f2ecf45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.713241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34ea17-f26a-48a6-bfd1-00478f2ecf45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fc34ea17-f26a-48a6-bfd1-00478f2ecf45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:34.718601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:34.719973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:34.720741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 75/152] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:34.721497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee51f3-0375-4f64-96e2-2e622f70e558 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.725866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee51f3-0375-4f64-96e2-2e622f70e558 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.726154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee51f3-0375-4f64-96e2-2e622f70e558 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.727570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 76/153] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:34.728743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99a1b-f704-4ddb-b1f9-6f9841602c16 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.729029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99a1b-f704-4ddb-b1f9-6f9841602c16 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.729306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99a1b-f704-4ddb-b1f9-6f9841602c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.729602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d0ba6-8a73-4b17-87b6-35bc360b98eb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:34.733029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:34.741169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:34.762619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-dbc99a1b-f704-4ddb-b1f9-6f9841602c16 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:34.764089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dbc99a1b-f704-4ddb-b1f9-6f9841602c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:34.774646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7506d7-2383-409c-b71d-eb78e26b8d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:34.775671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7506d7-2383-409c-b71d-eb78e26b8d1e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.776251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7506d7-2383-409c-b71d-eb78e26b8d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.776753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7506d7-2383-409c-b71d-eb78e26b8d1e None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.778097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7506d7-2383-409c-b71d-eb78e26b8d1e None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:34.779812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7506d7-2383-409c-b71d-eb78e26b8d1e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:34.782286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 78/154] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:34 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:34.783756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59fa6-1bea-49d9-81e0-9663c0fc682e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:34.784239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59fa6-1bea-49d9-81e0-9663c0fc682e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:34.784762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59fa6-1bea-49d9-81e0-9663c0fc682e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:34.818586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-77c59fa6-1bea-49d9-81e0-9663c0fc682e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:34.820164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-77c59fa6-1bea-49d9-81e0-9663c0fc682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:34.903969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:34.904855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99a1b-f704-4ddb-b1f9-6f9841602c16 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:34.943543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 79/156] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:34.946692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c59fa6-1bea-49d9-81e0-9663c0fc682e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:35.080849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c59fa6-1bea-49d9-81e0-9663c0fc682e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:35.088848 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:35.099998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99a1b-f704-4ddb-b1f9-6f9841602c16 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:35.143494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:35.144502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:35.145001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:35.145501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:35.146370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:35.146864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:35.148502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:35.150339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:35.156619 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bec4f-d451-4869-b843-3da987937e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:35.157306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bec4f-d451-4869-b843-3da987937e0d None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:35.157625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bec4f-d451-4869-b843-3da987937e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:35.157991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bec4f-d451-4869-b843-3da987937e0d None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2/users/f5c2e4004db04004a045914f051ca755/roles/825bce4bc5ec40e8ba620d6514237e48` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:35.159883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bec4f-d451-4869-b843-3da987937e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=e24b490d9d7146659455e535a333fad2, user_id=f5c2e4004db04004a045914f051ca755, role_id=825bce4bc5ec40e8ba620d6514237e48)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:35.161557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bec4f-d451-4869-b843-3da987937e0d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:35.169028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 78/157] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:35.170129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:35.190542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:34 2022] PUT /identity/v3/projects/e24b490d9d7146659455e535a333fad2/users/f5c2e4004db04004a045914f051ca755/roles/825bce4bc5ec40e8ba620d6514237e48 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:35.191180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bec4f-d451-4869-b843-3da987937e0d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:35.346189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ebcbb-0814-4f81-a796-c7c541a3e053 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:35.399382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff879f3c-5bd3-4e90-85a2-b13168c67fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:35.400383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879f3c-5bd3-4e90-85a2-b13168c67fdd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:35.400920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879f3c-5bd3-4e90-85a2-b13168c67fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:35.401615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879f3c-5bd3-4e90-85a2-b13168c67fdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:35.411766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bec4f-d451-4869-b843-3da987937e0d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:35.427833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff879f3c-5bd3-4e90-85a2-b13168c67fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ff879f3c-5bd3-4e90-85a2-b13168c67fdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:35.434633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:35.435600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:35.436343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:35.440076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 79/159] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:35.454995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff879f3c-5bd3-4e90-85a2-b13168c67fdd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:35.479326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc2192-684c-4488-92da-c275b0686212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:35.479987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc2192-684c-4488-92da-c275b0686212 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:35.480287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc2192-684c-4488-92da-c275b0686212 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:35.480568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc2192-684c-4488-92da-c275b0686212 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:35.481794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc2192-684c-4488-92da-c275b0686212 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:35.483250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc2192-684c-4488-92da-c275b0686212 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:35.485803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 81/160] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:35 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:35.491519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc2192-684c-4488-92da-c275b0686212 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:35.555377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:35.574501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:35.651965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff879f3c-5bd3-4e90-85a2-b13168c67fdd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:35.697190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc2192-684c-4488-92da-c275b0686212 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:35.735026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:35.736242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:35.736879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:35.739482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:35.740417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:35.744050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:35.745822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:35.764169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 80/161] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:35.766606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:35.774565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f07185-55db-4454-bb96-3e362c6f8070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:35.776533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f07185-55db-4454-bb96-3e362c6f8070 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:35.777009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f07185-55db-4454-bb96-3e362c6f8070 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:35.779221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f07185-55db-4454-bb96-3e362c6f8070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:35.867130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f07185-55db-4454-bb96-3e362c6f8070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:35.869074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f07185-55db-4454-bb96-3e362c6f8070 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:35.904475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:35.990555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 82/162] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:35.994273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f07185-55db-4454-bb96-3e362c6f8070 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:36.029252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73889-8ce3-4f75-bbda-fa8dd2c90292 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:36.069749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:36.123192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698d972-c2df-44e1-8afe-a07286cc1d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:36.123848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d972-c2df-44e1-8afe-a07286cc1d38 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:36.124135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d972-c2df-44e1-8afe-a07286cc1d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:36.124421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d972-c2df-44e1-8afe-a07286cc1d38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:36.148333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698d972-c2df-44e1-8afe-a07286cc1d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:36.150165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f07185-55db-4454-bb96-3e362c6f8070 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9698d972-c2df-44e1-8afe-a07286cc1d38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:36.153879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:36.154805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:36.155584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:36.160444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:36.161338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698d972-c2df-44e1-8afe-a07286cc1d38 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:36.208684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:36.221257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe72212-86c0-4cfe-b46b-407fd8131960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:36.221931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe72212-86c0-4cfe-b46b-407fd8131960 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:36.222217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe72212-86c0-4cfe-b46b-407fd8131960 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:36.222494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe72212-86c0-4cfe-b46b-407fd8131960 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:36.242985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe72212-86c0-4cfe-b46b-407fd8131960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-dfe72212-86c0-4cfe-b46b-407fd8131960 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:36.248021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:36.249095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:36.249891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 00:59:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:36.251075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe72212-86c0-4cfe-b46b-407fd8131960 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:36.352282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698d972-c2df-44e1-8afe-a07286cc1d38 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:36.421508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f87962-cf27-43a2-9879-a5d507d56364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:36.423120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87962-cf27-43a2-9879-a5d507d56364 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:36.423648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87962-cf27-43a2-9879-a5d507d56364 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:36.424131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87962-cf27-43a2-9879-a5d507d56364 None admin] PATH_INFO: `/v3/users/802225de4e5b4f0395304da25f9b41c5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:36.426218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f87962-cf27-43a2-9879-a5d507d56364 None admin] RBAC: Authorizing `identity:get_user(user_id=802225de4e5b4f0395304da25f9b41c5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:36.427865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f87962-cf27-43a2-9879-a5d507d56364 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:36.430426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 82/165] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:36 2022] GET /identity/v3/users/802225de4e5b4f0395304da25f9b41c5 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:36.431379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f87962-cf27-43a2-9879-a5d507d56364 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:36.456166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe72212-86c0-4cfe-b46b-407fd8131960 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:36.523123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f74195-84a6-4885-be21-b00d3a19e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:36.523695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:36.523804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74195-84a6-4885-be21-b00d3a19e755 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:36.524043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74195-84a6-4885-be21-b00d3a19e755 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:36.524321 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f74195-84a6-4885-be21-b00d3a19e755 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:36.525516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f74195-84a6-4885-be21-b00d3a19e755 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:36.527020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f74195-84a6-4885-be21-b00d3a19e755 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:36.533526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 84/166] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:36 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:36.534380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f74195-84a6-4885-be21-b00d3a19e755 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:36.632602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:36.638688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f87962-cf27-43a2-9879-a5d507d56364 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:36.707106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f74195-84a6-4885-be21-b00d3a19e755 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:36.736242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:36.736856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:36.737132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:36.737417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:36.738083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:36.738382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:36.739746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:36.759546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 83/167] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:36.760400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:36.776135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:36.776775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:36.777061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:36.777338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:36.778059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:36.778365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:36.780137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:36.801696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 85/168] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 00:59:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:36.802631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:36.976558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b3474-0984-4c9d-8b9e-9bbe12299ee5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:37.002847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6f4d-ded9-46e9-a53d-0e00cec80043 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:37.004655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:37.029769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:37.034165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:37.035066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.035360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.035628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.036366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] RBAC: Adding query filter params (role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=e24b490d9d7146659455e535a333fad2, user.id=1526aa7734774ccf820a8c5a4d4f9a40) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:37.036669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:37.038462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:37.045093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 86/169] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:36 2022] GET /identity/v3/role_assignments?user.id=1526aa7734774ccf820a8c5a4d4f9a40&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=193a2ccbf16642a0af3edc128493946e => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:37.045965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:37.112523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1438345-aa82-4b0a-ae7b-f7da3402b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:37.113157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438345-aa82-4b0a-ae7b-f7da3402b6dc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.113438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438345-aa82-4b0a-ae7b-f7da3402b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.113719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438345-aa82-4b0a-ae7b-f7da3402b6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.285111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1438345-aa82-4b0a-ae7b-f7da3402b6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:37.286522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1438345-aa82-4b0a-ae7b-f7da3402b6dc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:37.307581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225da49-fce9-43ae-8b53-9100db3f94dc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:37.379648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a6f0e-30e7-401d-9ce9-9a33f650c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:37.380298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a6f0e-30e7-401d-9ce9-9a33f650c754 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.380574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a6f0e-30e7-401d-9ce9-9a33f650c754 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.380846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a6f0e-30e7-401d-9ce9-9a33f650c754 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.382114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a6f0e-30e7-401d-9ce9-9a33f650c754 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:37.383568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a6f0e-30e7-401d-9ce9-9a33f650c754 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:37.385160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 87/170] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:37 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:37.385951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a6f0e-30e7-401d-9ce9-9a33f650c754 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:37.489222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:37.499498 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 84/171] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:37.501605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4963-76c0-4f43-9eba-3b1a501fadbd None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.501894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4963-76c0-4f43-9eba-3b1a501fadbd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.502168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4963-76c0-4f43-9eba-3b1a501fadbd None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.503630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 85/172] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:37.506815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4963-76c0-4f43-9eba-3b1a501fadbd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:37.525430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:37.556840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a6f0e-30e7-401d-9ce9-9a33f650c754 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:37.601147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685aa9-96f5-435d-8a50-c6c3c4a3aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:37.601877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685aa9-96f5-435d-8a50-c6c3c4a3aee7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.602178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685aa9-96f5-435d-8a50-c6c3c4a3aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.602450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685aa9-96f5-435d-8a50-c6c3c4a3aee7 None admin] PATH_INFO: `/v3/users/1526aa7734774ccf820a8c5a4d4f9a40` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.603587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685aa9-96f5-435d-8a50-c6c3c4a3aee7 None admin] RBAC: Authorizing `identity:get_user(user_id=1526aa7734774ccf820a8c5a4d4f9a40)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:37.605022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685aa9-96f5-435d-8a50-c6c3c4a3aee7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:37.606637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 88/173] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:37 2022] GET /identity/v3/users/1526aa7734774ccf820a8c5a4d4f9a40 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:37.607761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04fd7-1193-4b16-ab3d-5d7d9d219491 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.608038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04fd7-1193-4b16-ab3d-5d7d9d219491 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.608308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f04fd7-1193-4b16-ab3d-5d7d9d219491 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.610241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 89/174] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:37.610807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f04fd7-1193-4b16-ab3d-5d7d9d219491 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:37.644184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4963-76c0-4f43-9eba-3b1a501fadbd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:37.679421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c1f7-cc74-4172-8fdd-c6a7988febef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:37.680024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c1f7-cc74-4172-8fdd-c6a7988febef None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.680302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c1f7-cc74-4172-8fdd-c6a7988febef None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.680572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c1f7-cc74-4172-8fdd-c6a7988febef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.718418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f04fd7-1193-4b16-ab3d-5d7d9d219491 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:37.740642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:37.751472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c1f7-cc74-4172-8fdd-c6a7988febef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:37.752998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c1f7-cc74-4172-8fdd-c6a7988febef None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:37.757347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c975d09-baeb-4faf-bd6f-db846a916193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:37.758008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c975d09-baeb-4faf-bd6f-db846a916193 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.758286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c975d09-baeb-4faf-bd6f-db846a916193 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.758557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c975d09-baeb-4faf-bd6f-db846a916193 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.759680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c975d09-baeb-4faf-bd6f-db846a916193 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:37.761356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c975d09-baeb-4faf-bd6f-db846a916193 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:37.763247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 90/175] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:37 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:37.764232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:37.769274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0cc35-2871-4dd4-9a0a-2781c87297e3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.769588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0cc35-2871-4dd4-9a0a-2781c87297e3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.770183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0cc35-2871-4dd4-9a0a-2781c87297e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.789079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5dc0cc35-2871-4dd4-9a0a-2781c87297e3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:37.790292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5dc0cc35-2871-4dd4-9a0a-2781c87297e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:37.862214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 91/176] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:37.867252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 86/177] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:37.867399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fed18-c6d1-4b85-9669-774a6b778e6b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.867476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c1f7-cc74-4172-8fdd-c6a7988febef None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:37.867543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fed18-c6d1-4b85-9669-774a6b778e6b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.867543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fed18-c6d1-4b85-9669-774a6b778e6b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.867543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 92/178] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:37.867543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877cf9e-6717-4fb9-aa57-64b0a8eb811b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:37.867543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877cf9e-6717-4fb9-aa57-64b0a8eb811b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:37.867543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877cf9e-6717-4fb9-aa57-64b0a8eb811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:37.885616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d877cf9e-6717-4fb9-aa57-64b0a8eb811b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:37.886807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d877cf9e-6717-4fb9-aa57-64b0a8eb811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:37.957486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 93/179] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:37.962858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877cf9e-6717-4fb9-aa57-64b0a8eb811b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:37.985344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c1f7-cc74-4172-8fdd-c6a7988febef None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:37.998725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:38.024919 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a0341-8304-46d5-aae4-24cd4b2f326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:38.025988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a0341-8304-46d5-aae4-24cd4b2f326a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.026272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a0341-8304-46d5-aae4-24cd4b2f326a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.026689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a0341-8304-46d5-aae4-24cd4b2f326a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.064898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:38.112453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a0341-8304-46d5-aae4-24cd4b2f326a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:38.113938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a0341-8304-46d5-aae4-24cd4b2f326a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:38.155838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877cf9e-6717-4fb9-aa57-64b0a8eb811b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:38.201257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:38.202149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.202581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.204033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.204911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=e24b490d9d7146659455e535a333fad2, user.id=802225de4e5b4f0395304da25f9b41c5) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:38.205849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:38.208157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:38.215690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 94/180] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:37 2022] GET /identity/v3/role_assignments?user.id=802225de4e5b4f0395304da25f9b41c5&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=c182619b007b495f912901d866e751e1 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:38.217268 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:38.235243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 87/181] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:38.235243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08e96-2856-4e74-98ba-8b7b472a727a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.235243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08e96-2856-4e74-98ba-8b7b472a727a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.235243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08e96-2856-4e74-98ba-8b7b472a727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.252580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4bd08e96-2856-4e74-98ba-8b7b472a727a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:38.253948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4bd08e96-2856-4e74-98ba-8b7b472a727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:38.256433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:38.341487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:38.342960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08e96-2856-4e74-98ba-8b7b472a727a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:38.367008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020c118-033c-4f42-b685-58da8d801243 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:38.381793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:38.413004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbbb36-0a6f-4ceb-927c-b0965e9e00f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:38.413904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbb36-0a6f-4ceb-927c-b0965e9e00f5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.414351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbb36-0a6f-4ceb-927c-b0965e9e00f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.414766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbb36-0a6f-4ceb-927c-b0965e9e00f5 None admin] PATH_INFO: `/v3/projects/85bcc30405244f2187c8f87494089039` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.416036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbbb36-0a6f-4ceb-927c-b0965e9e00f5 None admin] RBAC: Authorizing `identity:get_project(project_id=85bcc30405244f2187c8f87494089039)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:38.417711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbbb36-0a6f-4ceb-927c-b0965e9e00f5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:38.419861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 95/183] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:38 2022] GET /identity/v3/projects/85bcc30405244f2187c8f87494089039 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:38.421002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c039a4-cf1b-4f28-af43-a2ab0bce9edc None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.421278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c039a4-cf1b-4f28-af43-a2ab0bce9edc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.425643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c039a4-cf1b-4f28-af43-a2ab0bce9edc None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.427831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 96/184] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:38.428509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c039a4-cf1b-4f28-af43-a2ab0bce9edc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:38.475663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08e96-2856-4e74-98ba-8b7b472a727a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:38.528980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e487ea8-ca3b-4466-a330-b4bb8ad043ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:38.529727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e487ea8-ca3b-4466-a330-b4bb8ad043ba None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.530175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e487ea8-ca3b-4466-a330-b4bb8ad043ba None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.530461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e487ea8-ca3b-4466-a330-b4bb8ad043ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.540600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:38.544452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e487ea8-ca3b-4466-a330-b4bb8ad043ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:38.547965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c039a4-cf1b-4f28-af43-a2ab0bce9edc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5e487ea8-ca3b-4466-a330-b4bb8ad043ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:38.550491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:38.551361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:38.552128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:38.557563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 89/185] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:38.557563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e487ea8-ca3b-4466-a330-b4bb8ad043ba None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:38.584039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9ba3e-bc5c-4f62-a871-d650d3da9f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:38.584667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ba3e-bc5c-4f62-a871-d650d3da9f14 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.584941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ba3e-bc5c-4f62-a871-d650d3da9f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.585212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ba3e-bc5c-4f62-a871-d650d3da9f14 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.586375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9ba3e-bc5c-4f62-a871-d650d3da9f14 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:38.587909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9ba3e-bc5c-4f62-a871-d650d3da9f14 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:38.589554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 97/186] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:38 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:38.590304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9ba3e-bc5c-4f62-a871-d650d3da9f14 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:38.647136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:38.681695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e487ea8-ca3b-4466-a330-b4bb8ad043ba None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:38.697362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9ba3e-bc5c-4f62-a871-d650d3da9f14 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:38.716349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929248c7-0033-4c96-9a71-928bec690266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:38.716979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929248c7-0033-4c96-9a71-928bec690266 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.717262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929248c7-0033-4c96-9a71-928bec690266 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.717569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929248c7-0033-4c96-9a71-928bec690266 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.727707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929248c7-0033-4c96-9a71-928bec690266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:38.730295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:38.730896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.731172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.731440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.732157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] RBAC: Adding query filter params (role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=85bcc30405244f2187c8f87494089039, user.id=1526aa7734774ccf820a8c5a4d4f9a40) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:38.732460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-929248c7-0033-4c96-9a71-928bec690266 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:38.732585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:38.733447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:38.734564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:38.735302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:38.735376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 90/187] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 00:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:38.735376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599399a3-79c9-4311-9ce5-2d6095dc7f9b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.735655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599399a3-79c9-4311-9ce5-2d6095dc7f9b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.735948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599399a3-79c9-4311-9ce5-2d6095dc7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.739699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 98/188] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:38 2022] GET /identity/v3/role_assignments?user.id=1526aa7734774ccf820a8c5a4d4f9a40&scope.project.id=85bcc30405244f2187c8f87494089039&role.id=193a2ccbf16642a0af3edc128493946e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:38.740474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:38.756023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-599399a3-79c9-4311-9ce5-2d6095dc7f9b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:38.757470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-599399a3-79c9-4311-9ce5-2d6095dc7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:38.820695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:38.849439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 91/189] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:38.849439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599399a3-79c9-4311-9ce5-2d6095dc7f9b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:38.888368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d24b8-9e34-45ef-b98b-a8d166ac0ab2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:38.907992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:38.936396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:38.937961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:38.938185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:38.938465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:38.939146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:38.939451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:38.940834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:38.951054 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 99/190] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:38.952190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:38.974253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599399a3-79c9-4311-9ce5-2d6095dc7f9b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.025062 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.025742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.026022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.026301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.027151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] RBAC: Adding query filter params (role.id=72b0245082944533beab3a422c3c640a, scope.project.id=e24b490d9d7146659455e535a333fad2, user.id=1526aa7734774ccf820a8c5a4d4f9a40) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:39.027466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.029025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:39.036047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 92/191] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:38 2022] GET /identity/v3/role_assignments?user.id=1526aa7734774ccf820a8c5a4d4f9a40&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=72b0245082944533beab3a422c3c640a => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:39.036870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.083714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c462b-ab13-49b3-afb2-9f9e268fd72b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.100508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:39.140225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb9a00-dd17-4706-8bff-f5b437bacad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.141023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9a00-dd17-4706-8bff-f5b437bacad3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.141305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9a00-dd17-4706-8bff-f5b437bacad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.141612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9a00-dd17-4706-8bff-f5b437bacad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.142950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb9a00-dd17-4706-8bff-f5b437bacad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.144424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb9a00-dd17-4706-8bff-f5b437bacad3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:39.146266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 100/192] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:39.147048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb9a00-dd17-4706-8bff-f5b437bacad3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.179730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9055ea-c657-4e97-bbe4-ddb7b21a34ab None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.197266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:39.220562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.221664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.221664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.221664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.222771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:39.222771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.223968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:39.236537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 93/193] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 00:59:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:39.237487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.266842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb9a00-dd17-4706-8bff-f5b437bacad3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.301975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edf4e8-667f-4bf6-a90b-13d9fabcbdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.302606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edf4e8-667f-4bf6-a90b-13d9fabcbdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.302881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edf4e8-667f-4bf6-a90b-13d9fabcbdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.303153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edf4e8-667f-4bf6-a90b-13d9fabcbdc5 None admin] PATH_INFO: `/v3/users/a6bae8cd97844e9990f9733a3c914ada` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.317317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edf4e8-667f-4bf6-a90b-13d9fabcbdc5 None admin] RBAC: Authorizing `identity:get_user(user_id=a6bae8cd97844e9990f9733a3c914ada)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.318875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edf4e8-667f-4bf6-a90b-13d9fabcbdc5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:39.320477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 101/194] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:39 2022] GET /identity/v3/users/a6bae8cd97844e9990f9733a3c914ada => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:39.321300 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edf4e8-667f-4bf6-a90b-13d9fabcbdc5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.350238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c23319-7611-4b94-b85a-23f963d1f5bf None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.363544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:39.384711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab46dc-8ea6-4805-96c9-b2dc60f51cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.385340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab46dc-8ea6-4805-96c9-b2dc60f51cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.385671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab46dc-8ea6-4805-96c9-b2dc60f51cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.385945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab46dc-8ea6-4805-96c9-b2dc60f51cd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.396341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab46dc-8ea6-4805-96c9-b2dc60f51cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-49ab46dc-8ea6-4805-96c9-b2dc60f51cd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:39.401640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:39.402501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 94/195] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:39.408767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab46dc-8ea6-4805-96c9-b2dc60f51cd5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.416177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:39.419387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edf4e8-667f-4bf6-a90b-13d9fabcbdc5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.456371 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00861ac-c4d5-4ef9-bc66-489c90f6dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.456909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00861ac-c4d5-4ef9-bc66-489c90f6dca6 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.457191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00861ac-c4d5-4ef9-bc66-489c90f6dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.457493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00861ac-c4d5-4ef9-bc66-489c90f6dca6 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.458142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00861ac-c4d5-4ef9-bc66-489c90f6dca6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.459571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00861ac-c4d5-4ef9-bc66-489c90f6dca6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:39.479099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 102/196] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 00:59:39 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:39.479955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00861ac-c4d5-4ef9-bc66-489c90f6dca6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.511984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab46dc-8ea6-4805-96c9-b2dc60f51cd5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.554599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f03c6-3503-4e20-aeef-6d0476e63e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.555345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f03c6-3503-4e20-aeef-6d0476e63e29 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.555632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f03c6-3503-4e20-aeef-6d0476e63e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.555908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f03c6-3503-4e20-aeef-6d0476e63e29 None admin] PATH_INFO: `/v3/users/a6bae8cd97844e9990f9733a3c914ada` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.557120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f03c6-3503-4e20-aeef-6d0476e63e29 None admin] RBAC: Authorizing `identity:get_user(user_id=a6bae8cd97844e9990f9733a3c914ada)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.558651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f03c6-3503-4e20-aeef-6d0476e63e29 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:39.565654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 95/197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:39 2022] GET /identity/v3/users/a6bae8cd97844e9990f9733a3c914ada => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:39.565654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f03c6-3503-4e20-aeef-6d0476e63e29 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.607607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:39.619209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00861ac-c4d5-4ef9-bc66-489c90f6dca6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.657900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fa52a-940f-4219-ab99-7c5dd7e756f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.658519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa52a-940f-4219-ab99-7c5dd7e756f5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.658804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa52a-940f-4219-ab99-7c5dd7e756f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.659067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fa52a-940f-4219-ab99-7c5dd7e756f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.679532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f03c6-3503-4e20-aeef-6d0476e63e29 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.688937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:39.716328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.716858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.717139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.717438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.718107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:39.718413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.719854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:39.729141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 96/198] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:39.730374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.747721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fa52a-940f-4219-ab99-7c5dd7e756f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.749958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fa52a-940f-4219-ab99-7c5dd7e756f5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:39.853672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359724-6c32-402a-b58a-260c1cfe8287 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:39.856722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:39.872399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 103/199] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:39.877502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fa52a-940f-4219-ab99-7c5dd7e756f5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:39.904820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5029-96a8-4d90-88f5-c71773f58687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:39.905465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5029-96a8-4d90-88f5-c71773f58687 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:39.905856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5029-96a8-4d90-88f5-c71773f58687 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:39.906138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5029-96a8-4d90-88f5-c71773f58687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:39.946122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:39.988862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5029-96a8-4d90-88f5-c71773f58687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:39.990297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5029-96a8-4d90-88f5-c71773f58687 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.011162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fa52a-940f-4219-ab99-7c5dd7e756f5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:40.057935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef17d-610e-4cd0-9f6c-83f1fb49c749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:40.059143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef17d-610e-4cd0-9f6c-83f1fb49c749 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:40.059634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef17d-610e-4cd0-9f6c-83f1fb49c749 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:40.060574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ef17d-610e-4cd0-9f6c-83f1fb49c749 None admin] PATH_INFO: `/v3/users/f5c2e4004db04004a045914f051ca755` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:40.062186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ef17d-610e-4cd0-9f6c-83f1fb49c749 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c2e4004db04004a045914f051ca755)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:40.064839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ef17d-610e-4cd0-9f6c-83f1fb49c749 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.066803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 104/200] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:39 2022] GET /identity/v3/users/f5c2e4004db04004a045914f051ca755 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:40.067860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef17d-610e-4cd0-9f6c-83f1fb49c749 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:40.110134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 97/201] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:40.110134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5029-96a8-4d90-88f5-c71773f58687 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:40.113734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:40.193014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ef17d-610e-4cd0-9f6c-83f1fb49c749 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:40.217565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:40.228925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f263d76-9940-4327-80cc-f343c3a8818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:40.229605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f263d76-9940-4327-80cc-f343c3a8818b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:40.229884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f263d76-9940-4327-80cc-f343c3a8818b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:40.230172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f263d76-9940-4327-80cc-f343c3a8818b None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:40.231445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f263d76-9940-4327-80cc-f343c3a8818b None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:40.232537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5029-96a8-4d90-88f5-c71773f58687 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:40.232881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f263d76-9940-4327-80cc-f343c3a8818b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.239581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 105/202] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:40 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:40.239581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f263d76-9940-4327-80cc-f343c3a8818b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:40.282819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ca44-f216-48fb-93ed-c0b3f4ee9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:40.284313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ca44-f216-48fb-93ed-c0b3f4ee9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:40.284858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ca44-f216-48fb-93ed-c0b3f4ee9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:40.285329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ca44-f216-48fb-93ed-c0b3f4ee9fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:40.359940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f263d76-9940-4327-80cc-f343c3a8818b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:40.370725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061ca44-f216-48fb-93ed-c0b3f4ee9fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:40.372291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061ca44-f216-48fb-93ed-c0b3f4ee9fd6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.377147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:40.410094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df66d2-d222-48c8-8804-509b9a030390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:40.410729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df66d2-d222-48c8-8804-509b9a030390 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:40.411010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df66d2-d222-48c8-8804-509b9a030390 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:40.411280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df66d2-d222-48c8-8804-509b9a030390 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:40.412555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df66d2-d222-48c8-8804-509b9a030390 None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:40.414044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df66d2-d222-48c8-8804-509b9a030390 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.420621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 106/203] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:40 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:40.421507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df66d2-d222-48c8-8804-509b9a030390 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:40.482130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:40.502499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 98/204] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:40.506801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ca44-f216-48fb-93ed-c0b3f4ee9fd6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:40.538215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df66d2-d222-48c8-8804-509b9a030390 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:40.585707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:40.587173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:40.587697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:40.588160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:40.589277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=c74b7a27d82349698d162ee8c4036e4b, user.id=a6bae8cd97844e9990f9733a3c914ada) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:40.590150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:40.592121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.600844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 107/205] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:40 2022] GET /identity/v3/role_assignments?user.id=a6bae8cd97844e9990f9733a3c914ada&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=c182619b007b495f912901d866e751e1 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:40.601802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:40.670174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ca44-f216-48fb-93ed-c0b3f4ee9fd6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:40.678356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:40.717386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:40.718264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:40.718672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:40.719637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:40.721093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] RBAC: Adding query filter params (role.id=72b0245082944533beab3a422c3c640a, scope.project.id=c74b7a27d82349698d162ee8c4036e4b, user.id=a6bae8cd97844e9990f9733a3c914ada) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:40.721602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:40.723361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.730198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 99/206] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:40 2022] GET /identity/v3/role_assignments?user.id=a6bae8cd97844e9990f9733a3c914ada&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=72b0245082944533beab3a422c3c640a => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:40.778529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c5b6c-aa39-44f0-bd9d-9ccbe6ad1b31 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:40.807622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:40.820766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37637182-34a3-4ece-a0fb-c333d8921afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:40.821469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37637182-34a3-4ece-a0fb-c333d8921afe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:40.821757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37637182-34a3-4ece-a0fb-c333d8921afe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:40.822031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37637182-34a3-4ece-a0fb-c333d8921afe None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:40.823374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37637182-34a3-4ece-a0fb-c333d8921afe None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:40.824923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37637182-34a3-4ece-a0fb-c333d8921afe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.826738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 108/207] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:40 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:40.833690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:40.946852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b84757-c77e-4cb8-9015-771437b9e67c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:40.982365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce62690-0db5-4d0c-89ee-a1c32ebdc932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:40.982975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce62690-0db5-4d0c-89ee-a1c32ebdc932 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:40.983257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce62690-0db5-4d0c-89ee-a1c32ebdc932 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:40.983526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce62690-0db5-4d0c-89ee-a1c32ebdc932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:40.984250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce62690-0db5-4d0c-89ee-a1c32ebdc932 None admin] RBAC: Adding query filter params (role.id=825bce4bc5ec40e8ba620d6514237e48, scope.project.id=e24b490d9d7146659455e535a333fad2, user.id=f5c2e4004db04004a045914f051ca755) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:40.985096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce62690-0db5-4d0c-89ee-a1c32ebdc932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:40.986572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce62690-0db5-4d0c-89ee-a1c32ebdc932 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:40.992879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 100/208] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:40 2022] GET /identity/v3/role_assignments?user.id=f5c2e4004db04004a045914f051ca755&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=825bce4bc5ec40e8ba620d6514237e48 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:41.971031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04883cf-0132-45ff-81c9-4f3665150d07 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:41.971549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04883cf-0132-45ff-81c9-4f3665150d07 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:41.971549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04883cf-0132-45ff-81c9-4f3665150d07 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:41.973236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 109/209] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:41.978947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd1c2-fc3e-4ca0-86c9-180aab1b2faa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:41.979369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd1c2-fc3e-4ca0-86c9-180aab1b2faa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:41.979537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd1c2-fc3e-4ca0-86c9-180aab1b2faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:41.996168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb16b0-3029-4ac9-88f4-a9c27740662b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:41.996764 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb16b0-3029-4ac9-88f4-a9c27740662b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:41.997259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb16b0-3029-4ac9-88f4-a9c27740662b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:41.998536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-355cd1c2-fc3e-4ca0-86c9-180aab1b2faa None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:41.999163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 110/210] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:42.001858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-355cd1c2-fc3e-4ca0-86c9-180aab1b2faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:42.005659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349420e5-e675-4c67-b8b9-7d19ba41eaa3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:42.006169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349420e5-e675-4c67-b8b9-7d19ba41eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:42.006640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349420e5-e675-4c67-b8b9-7d19ba41eaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:42.029359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:42.029837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-349420e5-e675-4c67-b8b9-7d19ba41eaa3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:42.032117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-349420e5-e675-4c67-b8b9-7d19ba41eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:42.075046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 101/211] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:42.114529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 111/212] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:42.360295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cd1c2-fc3e-4ca0-86c9-180aab1b2faa None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:42.395522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349420e5-e675-4c67-b8b9-7d19ba41eaa3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:42.472281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cd1c2-fc3e-4ca0-86c9-180aab1b2faa None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:42.520022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680256b-3097-49cb-91cb-565d86c7a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:42.520701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680256b-3097-49cb-91cb-565d86c7a415 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:42.520954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680256b-3097-49cb-91cb-565d86c7a415 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:42.521229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680256b-3097-49cb-91cb-565d86c7a415 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:42.532629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680256b-3097-49cb-91cb-565d86c7a415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e680256b-3097-49cb-91cb-565d86c7a415 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:42.537815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:42.538696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:42.539471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:42.543391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349420e5-e675-4c67-b8b9-7d19ba41eaa3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:42.543711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 102/213] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:42.544576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680256b-3097-49cb-91cb-565d86c7a415 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:42.571608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:42.578457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:42.595489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4f59-0f02-4142-bb04-92ee13d3515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:42.596635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4f59-0f02-4142-bb04-92ee13d3515e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:42.597090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4f59-0f02-4142-bb04-92ee13d3515e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:42.597537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4f59-0f02-4142-bb04-92ee13d3515e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:42.599794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e4f59-0f02-4142-bb04-92ee13d3515e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:42.601702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e4f59-0f02-4142-bb04-92ee13d3515e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:42.604451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 112/214] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:42.610727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4f59-0f02-4142-bb04-92ee13d3515e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:42.670668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680256b-3097-49cb-91cb-565d86c7a415 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:42.711231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:42.711995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:42.712404 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:42.712840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:42.713667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:42.714190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:42.715746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:42.726851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 103/215] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:42.732515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:42.738351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4f59-0f02-4142-bb04-92ee13d3515e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:42.789302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043974f3-61fb-491e-8024-a7491f72548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:42.790598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043974f3-61fb-491e-8024-a7491f72548e None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:42.791327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043974f3-61fb-491e-8024-a7491f72548e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:42.791828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043974f3-61fb-491e-8024-a7491f72548e None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:42.793359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043974f3-61fb-491e-8024-a7491f72548e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:42.795673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043974f3-61fb-491e-8024-a7491f72548e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:42.824325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:42.827785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 113/216] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 00:59:42 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 00:59:42.865941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7311a0-5d5d-4dea-b886-ab43391bf90a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:42.907435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396776d6-b40b-4b9f-8525-02447add743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:42.908442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396776d6-b40b-4b9f-8525-02447add743f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:42.908911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396776d6-b40b-4b9f-8525-02447add743f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:42.909366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396776d6-b40b-4b9f-8525-02447add743f None admin] PATH_INFO: `/v3/users/6a82b0a5661e47bbabb30425bd298b26` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:42.928551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396776d6-b40b-4b9f-8525-02447add743f None admin] RBAC: Authorizing `identity:get_user(user_id=6a82b0a5661e47bbabb30425bd298b26)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:42.930638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396776d6-b40b-4b9f-8525-02447add743f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:42.932913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 104/217] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:42 2022] GET /identity/v3/users/6a82b0a5661e47bbabb30425bd298b26 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:42.943036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043974f3-61fb-491e-8024-a7491f72548e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:42.998164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:43.041909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4362ea-c827-4cf3-a51a-630d2a203ad0 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.042836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4362ea-c827-4cf3-a51a-630d2a203ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.043312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4362ea-c827-4cf3-a51a-630d2a203ad0 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.044954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 105/218] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:43.046222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047d05-8b84-452d-be4f-9190023ccf69 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.046719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047d05-8b84-452d-be4f-9190023ccf69 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.047162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22047d05-8b84-452d-be4f-9190023ccf69 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.048427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 106/219] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:43.051502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca4fa3-2f4a-4e52-abd8-6dd91a2059da None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.052024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca4fa3-2f4a-4e52-abd8-6dd91a2059da None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.052510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca4fa3-2f4a-4e52-abd8-6dd91a2059da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.068121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043974f3-61fb-491e-8024-a7491f72548e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:43.071393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-18ca4fa3-2f4a-4e52-abd8-6dd91a2059da None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:43.072798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-18ca4fa3-2f4a-4e52-abd8-6dd91a2059da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:43.106496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb265e-d8b8-41d7-b2ad-1123c323bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:43.106805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb265e-d8b8-41d7-b2ad-1123c323bd48 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.107034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb265e-d8b8-41d7-b2ad-1123c323bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.107311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb265e-d8b8-41d7-b2ad-1123c323bd48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.160452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 107/220] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:43.162019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7663e-4176-4a4b-970f-dd7cabdd42ee None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.162458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7663e-4176-4a4b-970f-dd7cabdd42ee None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.162911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7663e-4176-4a4b-970f-dd7cabdd42ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.183388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-adf7663e-4176-4a4b-970f-dd7cabdd42ee None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:43.185034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-adf7663e-4176-4a4b-970f-dd7cabdd42ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:43.196105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb265e-d8b8-41d7-b2ad-1123c323bd48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:43.197928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb265e-d8b8-41d7-b2ad-1123c323bd48 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:43.253587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:43.270894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 108/221] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:43.318425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 114/222] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:43.324207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7663e-4176-4a4b-970f-dd7cabdd42ee None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:43.331959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:43.440539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7663e-4176-4a4b-970f-dd7cabdd42ee None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:43.475682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb265e-d8b8-41d7-b2ad-1123c323bd48 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:43.478853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f348bdd-d817-4900-9a92-7f06f0e3dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:43.480436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348bdd-d817-4900-9a92-7f06f0e3dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.480717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348bdd-d817-4900-9a92-7f06f0e3dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.480994 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348bdd-d817-4900-9a92-7f06f0e3dfa1 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.482186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f348bdd-d817-4900-9a92-7f06f0e3dfa1 None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:43.483636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f348bdd-d817-4900-9a92-7f06f0e3dfa1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:43.486478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 109/223] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:43 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:43.492602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f348bdd-d817-4900-9a92-7f06f0e3dfa1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:43.605857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:43.630889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb265e-d8b8-41d7-b2ad-1123c323bd48 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:43.648067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f348bdd-d817-4900-9a92-7f06f0e3dfa1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:43.676652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817cc32-a767-4e56-be1a-92ddea8af45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:43.677816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cc32-a767-4e56-be1a-92ddea8af45e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.678246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cc32-a767-4e56-be1a-92ddea8af45e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.679103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817cc32-a767-4e56-be1a-92ddea8af45e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.690527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:43.691677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.691923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817cc32-a767-4e56-be1a-92ddea8af45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:43.692113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.692539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.693433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] RBAC: Adding query filter params (role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=c74b7a27d82349698d162ee8c4036e4b, user.id=6a82b0a5661e47bbabb30425bd298b26) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:43.693894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:43.695495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3817cc32-a767-4e56-be1a-92ddea8af45e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:43.697142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:43.698223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:43.699193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:43.701539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 115/224] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 00:59:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:43.702510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817cc32-a767-4e56-be1a-92ddea8af45e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:43.707797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 110/225] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:43 2022] GET /identity/v3/role_assignments?user.id=6a82b0a5661e47bbabb30425bd298b26&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=193a2ccbf16642a0af3edc128493946e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:43.709058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:43.716282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:43.843941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817cc32-a767-4e56-be1a-92ddea8af45e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:43.862220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1764e9-9bb2-44a9-81f1-2a8f3aea58e5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:43.896225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69f01f-3aaa-48d2-8461-6ff3dbe06e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:43.897181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f01f-3aaa-48d2-8461-6ff3dbe06e63 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.897699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f01f-3aaa-48d2-8461-6ff3dbe06e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.898149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f01f-3aaa-48d2-8461-6ff3dbe06e63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.900360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:43.900984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:43.901268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:43.901579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:43.902266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:43.902575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:43.903970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:43.905509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:43.914402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 111/226] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 00:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:43.919966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:43.925027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69f01f-3aaa-48d2-8461-6ff3dbe06e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-db69f01f-3aaa-48d2-8461-6ff3dbe06e63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:43.931039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:43.931937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:43.932705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:43.934823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 116/227] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:43.941617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69f01f-3aaa-48d2-8461-6ff3dbe06e63 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:44.059318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:44.082320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f15b73-ccf8-4b30-9cb6-2f12045ba6f7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:44.121976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69f01f-3aaa-48d2-8461-6ff3dbe06e63 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:44.150782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1461a-fcef-4873-ad3f-5101ddebdcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:44.151635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1461a-fcef-4873-ad3f-5101ddebdcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:44.152081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1461a-fcef-4873-ad3f-5101ddebdcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:44.153359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1461a-fcef-4873-ad3f-5101ddebdcc2 None admin] PATH_INFO: `/v3/users/a6bae8cd97844e9990f9733a3c914ada` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:44.156276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1461a-fcef-4873-ad3f-5101ddebdcc2 None admin] RBAC: Authorizing `identity:get_user(user_id=a6bae8cd97844e9990f9733a3c914ada)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:44.157946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1461a-fcef-4873-ad3f-5101ddebdcc2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:44.160202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 112/228] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:43 2022] GET /identity/v3/users/a6bae8cd97844e9990f9733a3c914ada => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:44.165687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1461a-fcef-4873-ad3f-5101ddebdcc2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:44.196779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:44.197662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:44.198100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:44.198509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:44.199324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:44.199766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:44.202794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:44.220415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 117/229] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:44.227007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:44.285573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:44.355197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1461a-fcef-4873-ad3f-5101ddebdcc2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:44.403809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51263412-fad3-4c92-a975-45936f8c47a7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:44.434601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:44.436967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc2f9b-cc78-46fb-ac52-87fe0decad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:44.438162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2f9b-cc78-46fb-ac52-87fe0decad10 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:44.438623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2f9b-cc78-46fb-ac52-87fe0decad10 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:44.439203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2f9b-cc78-46fb-ac52-87fe0decad10 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:44.442287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc2f9b-cc78-46fb-ac52-87fe0decad10 None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:44.444689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc2f9b-cc78-46fb-ac52-87fe0decad10 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:44.449194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 113/230] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:44 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:44.450844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fe411-4ded-49ba-9ecd-2a147e3d695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:44.451666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe411-4ded-49ba-9ecd-2a147e3d695a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:44.452182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe411-4ded-49ba-9ecd-2a147e3d695a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:44.452641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe411-4ded-49ba-9ecd-2a147e3d695a None admin] PATH_INFO: `/v3/users/a6bae8cd97844e9990f9733a3c914ada` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:44.453638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc2f9b-cc78-46fb-ac52-87fe0decad10 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:44.455642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fe411-4ded-49ba-9ecd-2a147e3d695a None admin] RBAC: Authorizing `identity:get_user(user_id=a6bae8cd97844e9990f9733a3c914ada)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:44.458967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fe411-4ded-49ba-9ecd-2a147e3d695a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:44.465429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 118/231] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:44 2022] GET /identity/v3/users/a6bae8cd97844e9990f9733a3c914ada => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:44.472692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fe411-4ded-49ba-9ecd-2a147e3d695a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:44.654825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fe411-4ded-49ba-9ecd-2a147e3d695a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:44.659945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc2f9b-cc78-46fb-ac52-87fe0decad10 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:44.710223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:44.713931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25175f-6334-481d-8822-dc733bf44a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:44.714570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25175f-6334-481d-8822-dc733bf44a4c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:44.714845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25175f-6334-481d-8822-dc733bf44a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:44.715095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25175f-6334-481d-8822-dc733bf44a4c None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:44.716928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25175f-6334-481d-8822-dc733bf44a4c None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:44.718389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25175f-6334-481d-8822-dc733bf44a4c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:44.720689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 119/232] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:44 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:44.723213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2c6a-0ee6-4f95-96f4-6fb2de85dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:44.723869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2c6a-0ee6-4f95-96f4-6fb2de85dcc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:44.724147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2c6a-0ee6-4f95-96f4-6fb2de85dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:44.724419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2c6a-0ee6-4f95-96f4-6fb2de85dcc7 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b/users/a6bae8cd97844e9990f9733a3c914ada/roles/72b0245082944533beab3a422c3c640a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:44.726793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25175f-6334-481d-8822-dc733bf44a4c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:44.727737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c2c6a-0ee6-4f95-96f4-6fb2de85dcc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c74b7a27d82349698d162ee8c4036e4b, user_id=a6bae8cd97844e9990f9733a3c914ada, role_id=72b0245082944533beab3a422c3c640a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:44.729167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c2c6a-0ee6-4f95-96f4-6fb2de85dcc7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:44.752907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 114/233] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:44 2022] PUT /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b/users/a6bae8cd97844e9990f9733a3c914ada/roles/72b0245082944533beab3a422c3c640a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:44.834607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:44.885705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25175f-6334-481d-8822-dc733bf44a4c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:44.928834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d78bb-e113-412c-862d-09117e91cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:44.929447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d78bb-e113-412c-862d-09117e91cb51 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:44.929736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d78bb-e113-412c-862d-09117e91cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:44.930009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d78bb-e113-412c-862d-09117e91cb51 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b/users/a6bae8cd97844e9990f9733a3c914ada/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:44.931962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d78bb-e113-412c-862d-09117e91cb51 None admin] RBAC: Authorizing `identity:create_grant(project_id=c74b7a27d82349698d162ee8c4036e4b, user_id=a6bae8cd97844e9990f9733a3c914ada, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:44.933438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d78bb-e113-412c-862d-09117e91cb51 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:44.948031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 120/234] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:44 2022] PUT /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b/users/a6bae8cd97844e9990f9733a3c914ada/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:45.605470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d556-0fb6-4636-8483-836661774819 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:45.606451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d556-0fb6-4636-8483-836661774819 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:45.606931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d556-0fb6-4636-8483-836661774819 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:45.608824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 115/235] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:45.619159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0785f-2be3-41ab-8704-684f08890bfd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:45.620136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0785f-2be3-41ab-8704-684f08890bfd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:45.620642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0785f-2be3-41ab-8704-684f08890bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:45.646017 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f5f0785f-2be3-41ab-8704-684f08890bfd None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:45.647252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f5f0785f-2be3-41ab-8704-684f08890bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:45.738816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 121/236] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:45.760161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87ec57-c5f6-4d7f-98c4-422af24304c8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:45.760754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87ec57-c5f6-4d7f-98c4-422af24304c8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:45.761234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87ec57-c5f6-4d7f-98c4-422af24304c8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:45.763286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 116/237] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:45.769357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023cca-9c8e-45d3-adae-99be842639e6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:45.769678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023cca-9c8e-45d3-adae-99be842639e6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:45.769949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023cca-9c8e-45d3-adae-99be842639e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:45.788514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b023cca-9c8e-45d3-adae-99be842639e6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:45.789762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b023cca-9c8e-45d3-adae-99be842639e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:45.855042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:45.878191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 122/238] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:46.063634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87ec57-c5f6-4d7f-98c4-422af24304c8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:46.221381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87ec57-c5f6-4d7f-98c4-422af24304c8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:46.255621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b023cca-9c8e-45d3-adae-99be842639e6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:46.283713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf912a2-096d-46ea-80c2-f4c31d8a105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:46.284350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf912a2-096d-46ea-80c2-f4c31d8a105c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:46.284632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf912a2-096d-46ea-80c2-f4c31d8a105c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:46.284906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf912a2-096d-46ea-80c2-f4c31d8a105c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:46.303581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf912a2-096d-46ea-80c2-f4c31d8a105c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8bf912a2-096d-46ea-80c2-f4c31d8a105c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:46.308462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:46.309318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:46.310114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 117/239] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:46.318420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf912a2-096d-46ea-80c2-f4c31d8a105c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:46.423362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:46.441688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b023cca-9c8e-45d3-adae-99be842639e6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:46.499165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbba371-9cd2-4e8a-bd39-cb452caf2913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:46.499819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbba371-9cd2-4e8a-bd39-cb452caf2913 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:46.500648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbba371-9cd2-4e8a-bd39-cb452caf2913 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:46.500924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbba371-9cd2-4e8a-bd39-cb452caf2913 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:46.502902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbba371-9cd2-4e8a-bd39-cb452caf2913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:46.510010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbba371-9cd2-4e8a-bd39-cb452caf2913 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:46.518987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf912a2-096d-46ea-80c2-f4c31d8a105c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:46.520893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 123/240] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:46.526965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbba371-9cd2-4e8a-bd39-cb452caf2913 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:46.573952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4d5a2-aecd-4593-b410-c66b37a17e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:46.574791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4d5a2-aecd-4593-b410-c66b37a17e73 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:46.575241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4d5a2-aecd-4593-b410-c66b37a17e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:46.575696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4d5a2-aecd-4593-b410-c66b37a17e73 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:46.576563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4d5a2-aecd-4593-b410-c66b37a17e73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:46.577015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4d5a2-aecd-4593-b410-c66b37a17e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:46.578659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4d5a2-aecd-4593-b410-c66b37a17e73 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:46.588076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 118/241] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:46.589773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f994c4-738a-48c6-a879-08b98f3ac64b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:46.590251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f994c4-738a-48c6-a879-08b98f3ac64b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:46.590707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f994c4-738a-48c6-a879-08b98f3ac64b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:46.592181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 119/242] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:46.593639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f994c4-738a-48c6-a879-08b98f3ac64b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:46.596943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:46.655421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbba371-9cd2-4e8a-bd39-cb452caf2913 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:46.697947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3be3d-f61a-4779-ad4b-6f8904b141c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:46.698853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3be3d-f61a-4779-ad4b-6f8904b141c2 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:46.699301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3be3d-f61a-4779-ad4b-6f8904b141c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:46.699960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3be3d-f61a-4779-ad4b-6f8904b141c2 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:46.700744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3be3d-f61a-4779-ad4b-6f8904b141c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:46.703164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3be3d-f61a-4779-ad4b-6f8904b141c2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:46.708704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f994c4-738a-48c6-a879-08b98f3ac64b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:46.726701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:46.735408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 124/243] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 00:59:46 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 00:59:46.735408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569183-7290-4718-b61c-193b5db8ed94 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:46.735408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569183-7290-4718-b61c-193b5db8ed94 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:46.735408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569183-7290-4718-b61c-193b5db8ed94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:46.772456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6d569183-7290-4718-b61c-193b5db8ed94 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:46.776901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6d569183-7290-4718-b61c-193b5db8ed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:46.785593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2af4-df06-4286-a8fd-92062c54943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:46.786623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2af4-df06-4286-a8fd-92062c54943b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:46.787258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2af4-df06-4286-a8fd-92062c54943b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:46.787780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2af4-df06-4286-a8fd-92062c54943b None admin] PATH_INFO: `/v3/users/c69326a6620844f2b5c586250aa1ae2d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:46.818099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a2af4-df06-4286-a8fd-92062c54943b None admin] RBAC: Authorizing `identity:get_user(user_id=c69326a6620844f2b5c586250aa1ae2d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:46.820663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a2af4-df06-4286-a8fd-92062c54943b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:46.826114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 120/244] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:46 2022] GET /identity/v3/users/c69326a6620844f2b5c586250aa1ae2d => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:46.835666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2af4-df06-4286-a8fd-92062c54943b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:46.891731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 125/245] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:46.993143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2af4-df06-4286-a8fd-92062c54943b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:47.028946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014edad-3725-4f13-a4ab-d294fbfa96b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:47.029597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014edad-3725-4f13-a4ab-d294fbfa96b2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.029900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014edad-3725-4f13-a4ab-d294fbfa96b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.030366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014edad-3725-4f13-a4ab-d294fbfa96b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.073832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:47.103344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014edad-3725-4f13-a4ab-d294fbfa96b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:47.104862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014edad-3725-4f13-a4ab-d294fbfa96b2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:47.178351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d569183-7290-4718-b61c-193b5db8ed94 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:47.225554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 121/246] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:47.226930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:47.238469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014edad-3725-4f13-a4ab-d294fbfa96b2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:47.303686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d569183-7290-4718-b61c-193b5db8ed94 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:47.347535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:47.352443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5456aa-3fe3-4ed6-ade0-a57e171e7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:47.352443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5456aa-3fe3-4ed6-ade0-a57e171e7432 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.352664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5456aa-3fe3-4ed6-ade0-a57e171e7432 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.352915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5456aa-3fe3-4ed6-ade0-a57e171e7432 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.370408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5456aa-3fe3-4ed6-ade0-a57e171e7432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-be5456aa-3fe3-4ed6-ade0-a57e171e7432 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:47.375392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:47.376278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:47.380415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 126/247] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:47.382205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5456aa-3fe3-4ed6-ade0-a57e171e7432 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:47.395768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014edad-3725-4f13-a4ab-d294fbfa96b2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:47.443744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c952e-7e75-4a94-9470-bf9fc8bab1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:47.444684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c952e-7e75-4a94-9470-bf9fc8bab1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.444970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c952e-7e75-4a94-9470-bf9fc8bab1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.445245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c952e-7e75-4a94-9470-bf9fc8bab1a8 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.446542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c952e-7e75-4a94-9470-bf9fc8bab1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:47.448121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c952e-7e75-4a94-9470-bf9fc8bab1a8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:47.450375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 122/248] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:47 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:47.457106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c952e-7e75-4a94-9470-bf9fc8bab1a8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:47.506642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:47.511665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5456aa-3fe3-4ed6-ade0-a57e171e7432 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:47.556870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:47.557907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.558414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.558889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.559760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:47.560266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:47.561881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:47.572356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 127/249] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:47.577881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:47.583786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c952e-7e75-4a94-9470-bf9fc8bab1a8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:47.624274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855dabf-6992-4784-ae8f-8a7fc43bf44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:47.625331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855dabf-6992-4784-ae8f-8a7fc43bf44e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.625719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855dabf-6992-4784-ae8f-8a7fc43bf44e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.625994 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855dabf-6992-4784-ae8f-8a7fc43bf44e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.626736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855dabf-6992-4784-ae8f-8a7fc43bf44e None admin] RBAC: Adding query filter params (role.id=825bce4bc5ec40e8ba620d6514237e48, scope.project.id=c74b7a27d82349698d162ee8c4036e4b, user.id=c69326a6620844f2b5c586250aa1ae2d) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:47.627047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855dabf-6992-4784-ae8f-8a7fc43bf44e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:47.628962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855dabf-6992-4784-ae8f-8a7fc43bf44e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:47.636962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 123/250] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:47 2022] GET /identity/v3/role_assignments?user.id=c69326a6620844f2b5c586250aa1ae2d&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=825bce4bc5ec40e8ba620d6514237e48 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:47.639500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fe07-2eb1-429b-b8ba-0bad79a88b3b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.640070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fe07-2eb1-429b-b8ba-0bad79a88b3b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.640070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2fe07-2eb1-429b-b8ba-0bad79a88b3b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.645428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 124/251] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:47.647417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539a6a-6213-43cd-a8d6-4233dbf65209 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.647706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539a6a-6213-43cd-a8d6-4233dbf65209 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.647979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539a6a-6213-43cd-a8d6-4233dbf65209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.656967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:47.669846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0c539a6a-6213-43cd-a8d6-4233dbf65209 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:47.671228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0c539a6a-6213-43cd-a8d6-4233dbf65209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:47.714631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13ad9e-c292-432e-9d1a-374dab9e842f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:47.748616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 125/252] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:47.750693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563932ec-8420-46d6-82fb-590bcaa2673c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.750981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563932ec-8420-46d6-82fb-590bcaa2673c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.751253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563932ec-8420-46d6-82fb-590bcaa2673c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.752525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 126/253] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:47.763206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014032ac-56e7-4024-a481-45aa6ba8bfd4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.763516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014032ac-56e7-4024-a481-45aa6ba8bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.763763 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014032ac-56e7-4024-a481-45aa6ba8bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.766286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0a90-9ebd-4dc6-ba10-260b80cd3690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:47.767380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0a90-9ebd-4dc6-ba10-260b80cd3690 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:47.767876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0a90-9ebd-4dc6-ba10-260b80cd3690 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:47.768352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0a90-9ebd-4dc6-ba10-260b80cd3690 None admin] PATH_INFO: `/v3/users/6a82b0a5661e47bbabb30425bd298b26` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:47.770058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0a90-9ebd-4dc6-ba10-260b80cd3690 None admin] RBAC: Authorizing `identity:get_user(user_id=6a82b0a5661e47bbabb30425bd298b26)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:47.771871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0a90-9ebd-4dc6-ba10-260b80cd3690 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:47.773897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 128/254] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:47 2022] GET /identity/v3/users/6a82b0a5661e47bbabb30425bd298b26 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:47.782522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0a90-9ebd-4dc6-ba10-260b80cd3690 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:47.788884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-014032ac-56e7-4024-a481-45aa6ba8bfd4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:47.790389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-014032ac-56e7-4024-a481-45aa6ba8bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:47.848484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:47.872343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 127/255] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:47.954759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0a90-9ebd-4dc6-ba10-260b80cd3690 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:48.006430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a3d5-4756-4bab-a07a-9d4a39394f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:48.007068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a3d5-4756-4bab-a07a-9d4a39394f75 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:48.007347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a3d5-4756-4bab-a07a-9d4a39394f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:48.007620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a3d5-4756-4bab-a07a-9d4a39394f75 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:48.008767 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a3d5-4756-4bab-a07a-9d4a39394f75 None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:48.010263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a3d5-4756-4bab-a07a-9d4a39394f75 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:48.012063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 129/256] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:47 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:48.018373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014032ac-56e7-4024-a481-45aa6ba8bfd4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:48.100136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a3d5-4756-4bab-a07a-9d4a39394f75 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:48.125836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:48.154278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014032ac-56e7-4024-a481-45aa6ba8bfd4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:48.231656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af437aa-2519-48e9-acca-b3afc7d224f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:48.232217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af437aa-2519-48e9-acca-b3afc7d224f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:48.232499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af437aa-2519-48e9-acca-b3afc7d224f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:48.232769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af437aa-2519-48e9-acca-b3afc7d224f6 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b/users/6a82b0a5661e47bbabb30425bd298b26/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:48.235350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af437aa-2519-48e9-acca-b3afc7d224f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c74b7a27d82349698d162ee8c4036e4b, user_id=6a82b0a5661e47bbabb30425bd298b26, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:48.237071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af437aa-2519-48e9-acca-b3afc7d224f6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:48.274861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 128/257] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:48 2022] PUT /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b/users/6a82b0a5661e47bbabb30425bd298b26/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:48.284049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:48.293941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a3d5-4756-4bab-a07a-9d4a39394f75 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:48.342912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101577-eeb4-4989-9b07-43096aacfa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:48.344270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101577-eeb4-4989-9b07-43096aacfa00 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:48.344565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101577-eeb4-4989-9b07-43096aacfa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:48.344841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101577-eeb4-4989-9b07-43096aacfa00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:48.352970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af437aa-2519-48e9-acca-b3afc7d224f6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:48.362865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101577-eeb4-4989-9b07-43096aacfa00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-95101577-eeb4-4989-9b07-43096aacfa00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:48.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:48.369563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:48.370347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 130/258] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 00:59:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:48.377522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101577-eeb4-4989-9b07-43096aacfa00 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:48.582238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101577-eeb4-4989-9b07-43096aacfa00 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:48.597597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af437aa-2519-48e9-acca-b3afc7d224f6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:48.642356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:48.657111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:48.657761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:48.658044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:48.658893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:48.659584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:48.660394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:48.661810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:48.665296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b6cd-c31e-4ee7-9915-01d2fa55b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:48.665988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b6cd-c31e-4ee7-9915-01d2fa55b69c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:48.666272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b6cd-c31e-4ee7-9915-01d2fa55b69c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:48.666569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b6cd-c31e-4ee7-9915-01d2fa55b69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:48.680325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 131/259] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 00:59:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:48.684857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3b6cd-c31e-4ee7-9915-01d2fa55b69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:48.687107 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-49e3b6cd-c31e-4ee7-9915-01d2fa55b69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:48.695399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:48.696380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:48.697156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 129/260] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 00:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:48.702481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b6cd-c31e-4ee7-9915-01d2fa55b69c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:48.724186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:48.887426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8d9b0-d89a-4d46-85a8-7199492c5079 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:48.891383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b6cd-c31e-4ee7-9915-01d2fa55b69c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:48.947061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:48.947681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:48.947966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:48.948764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:48.949458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:48.949774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:48.951644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:48.954511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae499c-1543-48f3-b1b0-719c0043e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:48.955145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae499c-1543-48f3-b1b0-719c0043e61b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:48.955464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae499c-1543-48f3-b1b0-719c0043e61b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:48.955762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae499c-1543-48f3-b1b0-719c0043e61b None admin] PATH_INFO: `/v3/users/a6bae8cd97844e9990f9733a3c914ada` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:48.957702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae499c-1543-48f3-b1b0-719c0043e61b None admin] RBAC: Authorizing `identity:get_user(user_id=a6bae8cd97844e9990f9733a3c914ada)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:48.959130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae499c-1543-48f3-b1b0-719c0043e61b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:48.960887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 132/261] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:48 2022] GET /identity/v3/users/a6bae8cd97844e9990f9733a3c914ada => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:48.967075 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 130/262] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:48.967942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae499c-1543-48f3-b1b0-719c0043e61b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:48.973278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:49.063370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:49.120587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:49.141187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae499c-1543-48f3-b1b0-719c0043e61b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:49.163390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce3eef-e6b1-4c94-b003-7e11f0c6941c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:49.214549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967610d0-06ca-4263-8fce-68004e113fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:49.215167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967610d0-06ca-4263-8fce-68004e113fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:49.215450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967610d0-06ca-4263-8fce-68004e113fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:49.215723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967610d0-06ca-4263-8fce-68004e113fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:49.230497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcc5b3-f9be-45e1-84aa-61d2717d6275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:49.231147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc5b3-f9be-45e1-84aa-61d2717d6275 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:49.231430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc5b3-f9be-45e1-84aa-61d2717d6275 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:49.231765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc5b3-f9be-45e1-84aa-61d2717d6275 None admin] PATH_INFO: `/v3/users/a6bae8cd97844e9990f9733a3c914ada` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:49.233466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcc5b3-f9be-45e1-84aa-61d2717d6275 None admin] RBAC: Authorizing `identity:get_user(user_id=a6bae8cd97844e9990f9733a3c914ada)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:49.234965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcc5b3-f9be-45e1-84aa-61d2717d6275 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:49.240280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 131/263] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:48 2022] GET /identity/v3/users/a6bae8cd97844e9990f9733a3c914ada => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:49.242373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcc5b3-f9be-45e1-84aa-61d2717d6275 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:49.364793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967610d0-06ca-4263-8fce-68004e113fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:49.366586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967610d0-06ca-4263-8fce-68004e113fc2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:49.422962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcc5b3-f9be-45e1-84aa-61d2717d6275 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:49.449738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:49.480749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0feca-11d6-4cef-a934-a9a87ecf4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:49.481368 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0feca-11d6-4cef-a934-a9a87ecf4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:49.481685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0feca-11d6-4cef-a934-a9a87ecf4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:49.481962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0feca-11d6-4cef-a934-a9a87ecf4cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:49.570889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:49.602422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0feca-11d6-4cef-a934-a9a87ecf4cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:49.603909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0feca-11d6-4cef-a934-a9a87ecf4cd1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:49.621696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 133/264] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:49.627809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967610d0-06ca-4263-8fce-68004e113fc2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:49.802258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 132/265] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:49.807967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0feca-11d6-4cef-a934-a9a87ecf4cd1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:49.811818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967610d0-06ca-4263-8fce-68004e113fc2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:49.845776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:49.880169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04799-c82e-46c0-a885-2c4f9eca3f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:49.880901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04799-c82e-46c0-a885-2c4f9eca3f94 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:49.881181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04799-c82e-46c0-a885-2c4f9eca3f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:49.881471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04799-c82e-46c0-a885-2c4f9eca3f94 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:49.886286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df04799-c82e-46c0-a885-2c4f9eca3f94 None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:49.889069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df04799-c82e-46c0-a885-2c4f9eca3f94 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:49.891545 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 134/266] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:49 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:49.897463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04799-c82e-46c0-a885-2c4f9eca3f94 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:49.977117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:50.029208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0feca-11d6-4cef-a934-a9a87ecf4cd1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:50.065425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04799-c82e-46c0-a885-2c4f9eca3f94 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:50.103627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:50.104244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.104532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.104806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:50.105559 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] RBAC: Adding query filter params (role.id=72b0245082944533beab3a422c3c640a, scope.project.id=c74b7a27d82349698d162ee8c4036e4b, user.id=a6bae8cd97844e9990f9733a3c914ada) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:50.105870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:50.107763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:50.114765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 135/267] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:49 2022] GET /identity/v3/role_assignments?user.id=a6bae8cd97844e9990f9733a3c914ada&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=72b0245082944533beab3a422c3c640a => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:50.123322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aace0f-2181-4536-afc4-0c891b13974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:50.123987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aace0f-2181-4536-afc4-0c891b13974f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.124265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aace0f-2181-4536-afc4-0c891b13974f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.124536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aace0f-2181-4536-afc4-0c891b13974f None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:50.126102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aace0f-2181-4536-afc4-0c891b13974f None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:50.127592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aace0f-2181-4536-afc4-0c891b13974f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:50.135498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:50.136402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 133/268] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:49 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:50.308280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024204-2bfe-4742-aa86-7170d42bc609 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:50.325286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765318ef-f780-4517-b06c-8858d88265d3 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.325620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765318ef-f780-4517-b06c-8858d88265d3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.325807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765318ef-f780-4517-b06c-8858d88265d3 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:50.327458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 134/269] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 00:59:50.332192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:50.341095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700cf7f-5cc7-46a6-b319-20025ddd7676 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.341374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700cf7f-5cc7-46a6-b319-20025ddd7676 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.341687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700cf7f-5cc7-46a6-b319-20025ddd7676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:50.370564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e8573-4bfc-4c73-ac1b-07632182d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:50.371286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8573-4bfc-4c73-ac1b-07632182d942 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.371572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8573-4bfc-4c73-ac1b-07632182d942 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.371852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8573-4bfc-4c73-ac1b-07632182d942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:50.372602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e8573-4bfc-4c73-ac1b-07632182d942 None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=c74b7a27d82349698d162ee8c4036e4b, user.id=a6bae8cd97844e9990f9733a3c914ada) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:50.372915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e8573-4bfc-4c73-ac1b-07632182d942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:50.374364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3700cf7f-5cc7-46a6-b319-20025ddd7676 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:50.374476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e8573-4bfc-4c73-ac1b-07632182d942 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:50.375665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3700cf7f-5cc7-46a6-b319-20025ddd7676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:50.381215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 136/270] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:50 2022] GET /identity/v3/role_assignments?user.id=a6bae8cd97844e9990f9733a3c914ada&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=c182619b007b495f912901d866e751e1 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:50.490718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 135/271] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:50.704616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba85b9-2d65-42b5-bf53-7533ed2f4a38 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.705312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba85b9-2d65-42b5-bf53-7533ed2f4a38 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.705828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba85b9-2d65-42b5-bf53-7533ed2f4a38 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:50.707651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 137/272] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:50.714885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ad37c-d1f3-4a0a-a9ed-d0195bba7ca7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.715347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ad37c-d1f3-4a0a-a9ed-d0195bba7ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.715761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ad37c-d1f3-4a0a-a9ed-d0195bba7ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:50.737296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7d9ad37c-d1f3-4a0a-a9ed-d0195bba7ca7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:50.738741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7d9ad37c-d1f3-4a0a-a9ed-d0195bba7ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:50.747260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:50.817644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 136/273] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:50.888910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba85b9-2d65-42b5-bf53-7533ed2f4a38 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:50.969692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ddfc-5a77-4cab-b905-7331e9107273 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.970309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ddfc-5a77-4cab-b905-7331e9107273 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.970793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ddfc-5a77-4cab-b905-7331e9107273 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:50.972744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 137/274] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:50.978686 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8439904-2c20-4b90-bc02-446d71fdcd62 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:50.978977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8439904-2c20-4b90-bc02-446d71fdcd62 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:50.979256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8439904-2c20-4b90-bc02-446d71fdcd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.010564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c8439904-2c20-4b90-bc02-446d71fdcd62 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:51.011758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c8439904-2c20-4b90-bc02-446d71fdcd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:51.024205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba85b9-2d65-42b5-bf53-7533ed2f4a38 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:51.063261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a66a64-4eb9-4b88-93f9-dda966d68da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:51.064227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a66a64-4eb9-4b88-93f9-dda966d68da2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.064732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a66a64-4eb9-4b88-93f9-dda966d68da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.065202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a66a64-4eb9-4b88-93f9-dda966d68da2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.066539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a66a64-4eb9-4b88-93f9-dda966d68da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:51.068174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a66a64-4eb9-4b88-93f9-dda966d68da2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:51.070274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 138/275] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:51.076832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a66a64-4eb9-4b88-93f9-dda966d68da2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:51.098820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 138/276] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:51.139144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:51.178417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8439904-2c20-4b90-bc02-446d71fdcd62 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:51.194793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a66a64-4eb9-4b88-93f9-dda966d68da2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:51.237525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ce22-004a-4719-b7d7-96879e6ff74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:51.238331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ce22-004a-4719-b7d7-96879e6ff74c None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.238616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ce22-004a-4719-b7d7-96879e6ff74c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.238887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ce22-004a-4719-b7d7-96879e6ff74c None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.239541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7ce22-004a-4719-b7d7-96879e6ff74c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:51.241161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7ce22-004a-4719-b7d7-96879e6ff74c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:51.257889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:51.277493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 139/277] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 00:59:51 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 00:59:51.304352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8439904-2c20-4b90-bc02-446d71fdcd62 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:51.344589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3dbc-8811-4525-a7d6-f587cbcda96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:51.345722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3dbc-8811-4525-a7d6-f587cbcda96e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.346250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3dbc-8811-4525-a7d6-f587cbcda96e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.346733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3dbc-8811-4525-a7d6-f587cbcda96e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.362374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d3dbc-8811-4525-a7d6-f587cbcda96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:51.367517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ce22-004a-4719-b7d7-96879e6ff74c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-379d3dbc-8811-4525-a7d6-f587cbcda96e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:51.371222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:51.372227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:51.373040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:51.378531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 139/278] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:51.385049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3dbc-8811-4525-a7d6-f587cbcda96e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:51.491531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ce22-004a-4719-b7d7-96879e6ff74c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:51.499147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:51.519581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3dbc-8811-4525-a7d6-f587cbcda96e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:51.536180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fc5c5-278f-4b0c-9ffd-84f7cd4b2ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:51.538335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fc5c5-278f-4b0c-9ffd-84f7cd4b2ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.538335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fc5c5-278f-4b0c-9ffd-84f7cd4b2ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.538335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fc5c5-278f-4b0c-9ffd-84f7cd4b2ce4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.550409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fc5c5-278f-4b0c-9ffd-84f7cd4b2ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5b4fc5c5-278f-4b0c-9ffd-84f7cd4b2ce4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:51.555802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:51.556724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:51.557532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 140/279] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:51.558183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24412cb3-e865-49c2-b6b4-8a472bfb1df1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.558378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24412cb3-e865-49c2-b6b4-8a472bfb1df1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.558614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24412cb3-e865-49c2-b6b4-8a472bfb1df1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.559839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 141/280] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:51.565881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f57f18-505c-4018-bb0d-d16a1408a749 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.566165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f57f18-505c-4018-bb0d-d16a1408a749 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.566441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f57f18-505c-4018-bb0d-d16a1408a749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.567682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:51.578023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:51.578728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.579006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.579279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.579956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:51.580260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:51.581770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:51.588314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-53f57f18-505c-4018-bb0d-d16a1408a749 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:51.589683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-53f57f18-505c-4018-bb0d-d16a1408a749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:51.597503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 140/281] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:51.598688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:51.677831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 142/282] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:51.678996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f57f18-505c-4018-bb0d-d16a1408a749 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:51.711721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354c261-3237-41cf-ac12-f52e2e6888d6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:51.748699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:51.749385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.749692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.750074 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.750850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:51.751159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:51.752537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:51.761786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 141/283] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:51.774617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:51.788779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f57f18-505c-4018-bb0d-d16a1408a749 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:51.820422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:51.834607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69c1e-f3d9-476b-8cc7-299e74bb7c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:51.835242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69c1e-f3d9-476b-8cc7-299e74bb7c49 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:51.835517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69c1e-f3d9-476b-8cc7-299e74bb7c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:51.835788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b69c1e-f3d9-476b-8cc7-299e74bb7c49 None admin] PATH_INFO: `/v3/users/c69326a6620844f2b5c586250aa1ae2d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:51.838374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69c1e-f3d9-476b-8cc7-299e74bb7c49 None admin] RBAC: Authorizing `identity:get_user(user_id=c69326a6620844f2b5c586250aa1ae2d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:51.839828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b69c1e-f3d9-476b-8cc7-299e74bb7c49 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:51.852071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 143/284] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:51 2022] GET /identity/v3/users/c69326a6620844f2b5c586250aa1ae2d => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:51.856149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69c1e-f3d9-476b-8cc7-299e74bb7c49 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:51.891389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:51.977913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b69c1e-f3d9-476b-8cc7-299e74bb7c49 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:52.000283 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3826-3125-4ca1-8851-fbe5528eca70 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:52.024337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e21df-eb4b-40cc-a91b-7a4a671732ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:52.025224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e21df-eb4b-40cc-a91b-7a4a671732ca None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:52.025641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e21df-eb4b-40cc-a91b-7a4a671732ca None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:52.026009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e21df-eb4b-40cc-a91b-7a4a671732ca None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:52.027220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e21df-eb4b-40cc-a91b-7a4a671732ca None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:52.028872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e21df-eb4b-40cc-a91b-7a4a671732ca None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:52.030819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 144/285] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:51 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:52.031659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e21df-eb4b-40cc-a91b-7a4a671732ca None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:52.046318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0651a8-f384-40cc-9bbf-5062c3635777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:52.047475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0651a8-f384-40cc-9bbf-5062c3635777 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:52.047947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0651a8-f384-40cc-9bbf-5062c3635777 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:52.048804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0651a8-f384-40cc-9bbf-5062c3635777 None admin] PATH_INFO: `/v3/users/9ac97011100b44d5906a751b80822419` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:52.067129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0651a8-f384-40cc-9bbf-5062c3635777 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac97011100b44d5906a751b80822419)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:52.069473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0651a8-f384-40cc-9bbf-5062c3635777 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:52.070246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:52.073247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 142/286] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:51 2022] GET /identity/v3/users/9ac97011100b44d5906a751b80822419 => generated 293 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:52.074566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0651a8-f384-40cc-9bbf-5062c3635777 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:52.152099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e21df-eb4b-40cc-a91b-7a4a671732ca None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:52.186790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b671-2c8e-48a8-a439-692a9499e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:52.187961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b671-2c8e-48a8-a439-692a9499e2ce None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:52.188241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b671-2c8e-48a8-a439-692a9499e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:52.188510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b671-2c8e-48a8-a439-692a9499e2ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:52.199230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b671-2c8e-48a8-a439-692a9499e2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9142b671-2c8e-48a8-a439-692a9499e2ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:52.204746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:52.205647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:52.206474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:52.209050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0651a8-f384-40cc-9bbf-5062c3635777 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:52.210791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 145/287] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:52.211709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b671-2c8e-48a8-a439-692a9499e2ce None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:52.228507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:52.253504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36206d3c-738a-46d4-83cb-e513965beaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:52.254290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206d3c-738a-46d4-83cb-e513965beaeb None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:52.254669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206d3c-738a-46d4-83cb-e513965beaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:52.255036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206d3c-738a-46d4-83cb-e513965beaeb None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b/users/c69326a6620844f2b5c586250aa1ae2d/roles/825bce4bc5ec40e8ba620d6514237e48` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:52.257056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36206d3c-738a-46d4-83cb-e513965beaeb None admin] RBAC: Authorizing `identity:create_grant(project_id=c74b7a27d82349698d162ee8c4036e4b, user_id=c69326a6620844f2b5c586250aa1ae2d, role_id=825bce4bc5ec40e8ba620d6514237e48)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:52.258644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36206d3c-738a-46d4-83cb-e513965beaeb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:52.275662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 143/288] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 00:59:52 2022] PUT /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b/users/c69326a6620844f2b5c586250aa1ae2d/roles/825bce4bc5ec40e8ba620d6514237e48 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:52.275662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36206d3c-738a-46d4-83cb-e513965beaeb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:52.377788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:52.398081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36206d3c-738a-46d4-83cb-e513965beaeb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:52.398975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b671-2c8e-48a8-a439-692a9499e2ce None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:52.439528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:52.440218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:52.440503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:52.440778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:52.441510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:52.441885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:52.444018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:52.455839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 144/289] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:52.462290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:52.473858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:52.474484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:52.474758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:52.475026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:52.476622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] RBAC: Adding query filter params (role.id=193a2ccbf16642a0af3edc128493946e, user.id=9ac97011100b44d5906a751b80822419, scope.system=all) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:52.477015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:52.478531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:52.485666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 146/290] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Sep 8 00:59:52 2022] GET /identity/v3/role_assignments?user.id=9ac97011100b44d5906a751b80822419&scope.system=all&role.id=193a2ccbf16642a0af3edc128493946e => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:52.555846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:52.643206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ef7f7-6b70-41a3-8ea1-2a336112e4ac None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:52.684938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab37591-febb-4614-a03c-4b0a9107060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:52.685648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37591-febb-4614-a03c-4b0a9107060f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:52.685936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37591-febb-4614-a03c-4b0a9107060f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:52.686215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37591-febb-4614-a03c-4b0a9107060f None admin] PATH_INFO: `/v3/users/6a82b0a5661e47bbabb30425bd298b26` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:52.687998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab37591-febb-4614-a03c-4b0a9107060f None admin] RBAC: Authorizing `identity:get_user(user_id=6a82b0a5661e47bbabb30425bd298b26)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:52.689508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab37591-febb-4614-a03c-4b0a9107060f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:52.691183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 145/291] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:52 2022] GET /identity/v3/users/6a82b0a5661e47bbabb30425bd298b26 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:52.696893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:52.805298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d46829-d824-4dba-9eae-1ac6c4392d0c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:52.849626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68d6f-7aab-48bf-8fef-727c1dd612d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:52.850248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68d6f-7aab-48bf-8fef-727c1dd612d3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:52.850530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68d6f-7aab-48bf-8fef-727c1dd612d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:52.850813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68d6f-7aab-48bf-8fef-727c1dd612d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:52.881432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:52.933064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc68d6f-7aab-48bf-8fef-727c1dd612d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:52.934639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc68d6f-7aab-48bf-8fef-727c1dd612d3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:53.046453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 147/292] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 00:59:53.052544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab37591-febb-4614-a03c-4b0a9107060f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:53.166202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab37591-febb-4614-a03c-4b0a9107060f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:53.168626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:53.201797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026d2cd-76e5-4f91-bb55-1ae5fbcbd1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:53.202485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d2cd-76e5-4f91-bb55-1ae5fbcbd1ce None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:53.203274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d2cd-76e5-4f91-bb55-1ae5fbcbd1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:53.203601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d2cd-76e5-4f91-bb55-1ae5fbcbd1ce None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:53.204738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026d2cd-76e5-4f91-bb55-1ae5fbcbd1ce None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:53.206269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026d2cd-76e5-4f91-bb55-1ae5fbcbd1ce None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:53.207932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 146/293] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:53 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:53.213835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68d6f-7aab-48bf-8fef-727c1dd612d3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:53.282141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:53.340558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68d6f-7aab-48bf-8fef-727c1dd612d3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:53.375895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbad7a-8ffc-47d9-889f-8f3dcc2215e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:53.376560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbad7a-8ffc-47d9-889f-8f3dcc2215e7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:53.376844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbad7a-8ffc-47d9-889f-8f3dcc2215e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:53.377173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbad7a-8ffc-47d9-889f-8f3dcc2215e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:53.377990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbad7a-8ffc-47d9-889f-8f3dcc2215e7 None admin] RBAC: Adding query filter params (role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=c74b7a27d82349698d162ee8c4036e4b, user.id=6a82b0a5661e47bbabb30425bd298b26) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:53.378304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbad7a-8ffc-47d9-889f-8f3dcc2215e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:53.379745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbad7a-8ffc-47d9-889f-8f3dcc2215e7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:53.385762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 148/294] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:53 2022] GET /identity/v3/role_assignments?user.id=6a82b0a5661e47bbabb30425bd298b26&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=193a2ccbf16642a0af3edc128493946e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:54.107705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb2f0-bd81-40d3-b998-8275034e7116 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.108717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb2f0-bd81-40d3-b998-8275034e7116 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.109760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eb2f0-bd81-40d3-b998-8275034e7116 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.111423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 147/295] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:54.115582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b6f3-297c-4f84-bf62-9bab18b1df13 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.115983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b6f3-297c-4f84-bf62-9bab18b1df13 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.116165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b6f3-297c-4f84-bf62-9bab18b1df13 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.117643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 149/296] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:54.119056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988328-9f2e-4c55-aa4f-1903705df716 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.119343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988328-9f2e-4c55-aa4f-1903705df716 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.119619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83988328-9f2e-4c55-aa4f-1903705df716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.128746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326fa1-a4f9-473b-b2ba-a70bcee02ab3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.129033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326fa1-a4f9-473b-b2ba-a70bcee02ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.129316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326fa1-a4f9-473b-b2ba-a70bcee02ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.142126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-83988328-9f2e-4c55-aa4f-1903705df716 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:54.143640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-83988328-9f2e-4c55-aa4f-1903705df716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:54.152508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-01326fa1-a4f9-473b-b2ba-a70bcee02ab3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:54.154202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-01326fa1-a4f9-473b-b2ba-a70bcee02ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:54.224684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 148/297] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:54.236513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 150/298] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:54.494251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988328-9f2e-4c55-aa4f-1903705df716 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:54.508196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01326fa1-a4f9-473b-b2ba-a70bcee02ab3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:54.580568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:54.616230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83988328-9f2e-4c55-aa4f-1903705df716 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:54.618620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:54.648248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01326fa1-a4f9-473b-b2ba-a70bcee02ab3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:54.666330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034f6c-bd4d-437f-9b7d-e47f160af325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:54.666971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034f6c-bd4d-437f-9b7d-e47f160af325 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.667255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034f6c-bd4d-437f-9b7d-e47f160af325 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.667533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034f6c-bd4d-437f-9b7d-e47f160af325 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.683602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034f6c-bd4d-437f-9b7d-e47f160af325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:54.687647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d236685-39e7-47de-8717-6ee7630d3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:54.688522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236685-39e7-47de-8717-6ee7630d3e1c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.688993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236685-39e7-47de-8717-6ee7630d3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-03034f6c-bd4d-437f-9b7d-e47f160af325 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:54.689397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:54.690260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:54.691046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 149/299] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:54.691825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236685-39e7-47de-8717-6ee7630d3e1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.694698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d236685-39e7-47de-8717-6ee7630d3e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:54.696549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d236685-39e7-47de-8717-6ee7630d3e1c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:54.696656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034f6c-bd4d-437f-9b7d-e47f160af325 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:54.698591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 151/300] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:54.707261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d236685-39e7-47de-8717-6ee7630d3e1c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:54.820498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d236685-39e7-47de-8717-6ee7630d3e1c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:54.836887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034f6c-bd4d-437f-9b7d-e47f160af325 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:54.841043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:54.863171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906034d-1533-4e43-a59a-496bc0ac2ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:54.864185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906034d-1533-4e43-a59a-496bc0ac2ed7 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.864660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906034d-1533-4e43-a59a-496bc0ac2ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.865122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906034d-1533-4e43-a59a-496bc0ac2ed7 None admin] PATH_INFO: `/v3/groups` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.865988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906034d-1533-4e43-a59a-496bc0ac2ed7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:54.867488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906034d-1533-4e43-a59a-496bc0ac2ed7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:54.876992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:54.877634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.877990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.878205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.878933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:54.879243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:54.880640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:54.885542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 152/301] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Sep 8 00:59:54 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 00:59:54.888301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ad9b-7c24-4402-a218-fab142a11ab9 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.888794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ad9b-7c24-4402-a218-fab142a11ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.889311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ad9b-7c24-4402-a218-fab142a11ab9 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.894982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 150/302] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:54.895356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 153/303] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:54.896320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:54.897262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e04c0-d3b3-4732-b6f1-f1ab02aceb8b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:54.897779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e04c0-d3b3-4732-b6f1-f1ab02aceb8b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:54.898253 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e04c0-d3b3-4732-b6f1-f1ab02aceb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:54.924628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ef2e04c0-d3b3-4732-b6f1-f1ab02aceb8b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:54.926509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ef2e04c0-d3b3-4732-b6f1-f1ab02aceb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:54.927519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:55.022569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daca9d-4088-4595-98c6-93df8a24c1d2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:55.041089 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 154/304] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:55.067997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755e47-097e-4fcd-aa87-bfde90185303 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.068604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755e47-097e-4fcd-aa87-bfde90185303 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.068884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96755e47-097e-4fcd-aa87-bfde90185303 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.070488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 155/305] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:55.075695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4def95-27f8-46ed-b614-c80cf2637e50 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.075903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3337-8057-414f-9d8d-c8f067055d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:55.076019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4def95-27f8-46ed-b614-c80cf2637e50 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.076173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4def95-27f8-46ed-b614-c80cf2637e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.076543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3337-8057-414f-9d8d-c8f067055d0f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.076825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3337-8057-414f-9d8d-c8f067055d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.077102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3337-8057-414f-9d8d-c8f067055d0f None admin] PATH_INFO: `/v3/users/35bb9840941c4ba8936399d878f378a2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.091737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a3337-8057-414f-9d8d-c8f067055d0f None admin] RBAC: Authorizing `identity:get_user(user_id=35bb9840941c4ba8936399d878f378a2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:55.093215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a3337-8057-414f-9d8d-c8f067055d0f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:55.095618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 151/306] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:54 2022] GET /identity/v3/users/35bb9840941c4ba8936399d878f378a2 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:55.096719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b4def95-27f8-46ed-b614-c80cf2637e50 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:55.098093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b4def95-27f8-46ed-b614-c80cf2637e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:55.101303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3337-8057-414f-9d8d-c8f067055d0f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:55.186552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 156/307] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:55.205604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:55.224804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3337-8057-414f-9d8d-c8f067055d0f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:55.260109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:55.260718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.261000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.261321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.262082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] RBAC: Adding query filter params (role.id=825bce4bc5ec40e8ba620d6514237e48, user.id=35bb9840941c4ba8936399d878f378a2, scope.system=all) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:55.262444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:55.264203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:55.269639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 152/308] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Sep 8 00:59:55 2022] GET /identity/v3/role_assignments?user.id=35bb9840941c4ba8936399d878f378a2&scope.system=all&role.id=825bce4bc5ec40e8ba620d6514237e48 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:55.317621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4def95-27f8-46ed-b614-c80cf2637e50 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:55.364303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:55.439660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4def95-27f8-46ed-b614-c80cf2637e50 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:55.458788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:55.485985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42325c-c56c-4004-be9d-4d152c5ce609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:55.487168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42325c-c56c-4004-be9d-4d152c5ce609 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.487449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42325c-c56c-4004-be9d-4d152c5ce609 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.487722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42325c-c56c-4004-be9d-4d152c5ce609 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.503244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42325c-c56c-4004-be9d-4d152c5ce609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8e42325c-c56c-4004-be9d-4d152c5ce609 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:55.517425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:55.518501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 157/309] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:55.519453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42325c-c56c-4004-be9d-4d152c5ce609 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:55.579402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cadb1c-c020-4527-9437-8cb810c385b6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:55.615392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cd66-77ab-4335-bbf4-498a3a915c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:55.616057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cd66-77ab-4335-bbf4-498a3a915c8f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.616417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cd66-77ab-4335-bbf4-498a3a915c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.616769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cd66-77ab-4335-bbf4-498a3a915c8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.627927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6cd66-77ab-4335-bbf4-498a3a915c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:55.632576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42325c-c56c-4004-be9d-4d152c5ce609 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4ae6cd66-77ab-4335-bbf4-498a3a915c8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:55.633760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:55.634901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:55.636076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:55.637074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:55.637155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 153/310] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 00:59:55.641938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cd66-77ab-4335-bbf4-498a3a915c8f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:55.651680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:55.676871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:55.677532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.677887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.678256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.679045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:55.679424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:55.680892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:55.689993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 158/311] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:55.695782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:55.776094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cd66-77ab-4335-bbf4-498a3a915c8f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:55.827250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:55.828081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.828375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.828766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.829457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:55.829772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:55.831406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:55.832307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4967-5208-41ea-95e3-fed679124b71 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:55.841677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 154/312] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:55.848318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:55.877562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602c55-6a70-43a9-a9b0-b2d071d90d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:55.878598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602c55-6a70-43a9-a9b0-b2d071d90d8e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:55.879090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602c55-6a70-43a9-a9b0-b2d071d90d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:55.879570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602c55-6a70-43a9-a9b0-b2d071d90d8e None admin] PATH_INFO: `/v3/users/c69326a6620844f2b5c586250aa1ae2d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:55.881024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2602c55-6a70-43a9-a9b0-b2d071d90d8e None admin] RBAC: Authorizing `identity:get_user(user_id=c69326a6620844f2b5c586250aa1ae2d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:55.882745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2602c55-6a70-43a9-a9b0-b2d071d90d8e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:55.884577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 159/313] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:55 2022] GET /identity/v3/users/c69326a6620844f2b5c586250aa1ae2d => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:55.890533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602c55-6a70-43a9-a9b0-b2d071d90d8e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:55.920110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:55.932961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:55.975771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5f7c-3464-4d83-bf8a-c4bc9db4d478 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:56.001940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602c55-6a70-43a9-a9b0-b2d071d90d8e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:56.017981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04beeaa-24ad-43f8-9c31-dfb1f81060f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:56.018622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04beeaa-24ad-43f8-9c31-dfb1f81060f3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:56.018914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04beeaa-24ad-43f8-9c31-dfb1f81060f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:56.019176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04beeaa-24ad-43f8-9c31-dfb1f81060f3 None admin] PATH_INFO: `/v3/users/9ac97011100b44d5906a751b80822419` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:56.020313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04beeaa-24ad-43f8-9c31-dfb1f81060f3 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac97011100b44d5906a751b80822419)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:56.021955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04beeaa-24ad-43f8-9c31-dfb1f81060f3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:56.028973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 155/314] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:55 2022] GET /identity/v3/users/9ac97011100b44d5906a751b80822419 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 00:59:56.029850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04beeaa-24ad-43f8-9c31-dfb1f81060f3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:56.043701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368602-165d-4a60-b9fa-c4dcb325d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:56.044671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368602-165d-4a60-b9fa-c4dcb325d698 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:56.045153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368602-165d-4a60-b9fa-c4dcb325d698 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:56.045742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79368602-165d-4a60-b9fa-c4dcb325d698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:56.121036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79368602-165d-4a60-b9fa-c4dcb325d698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:56.122917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79368602-165d-4a60-b9fa-c4dcb325d698 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:56.146733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04beeaa-24ad-43f8-9c31-dfb1f81060f3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:56.152639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:56.186515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef82092-5939-4cf5-a29c-11bd74600d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:56.187165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef82092-5939-4cf5-a29c-11bd74600d74 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:56.187432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef82092-5939-4cf5-a29c-11bd74600d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:56.187718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef82092-5939-4cf5-a29c-11bd74600d74 None admin] PATH_INFO: `/v3/system/users/9ac97011100b44d5906a751b80822419/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:56.189381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef82092-5939-4cf5-a29c-11bd74600d74 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9ac97011100b44d5906a751b80822419, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:56.191530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef82092-5939-4cf5-a29c-11bd74600d74 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:56.195565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:56.209514 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 156/315] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Sep 8 00:59:56 2022] PUT /identity/v3/system/users/9ac97011100b44d5906a751b80822419/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:56.252918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 160/316] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 00:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 00:59:56.263456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef82092-5939-4cf5-a29c-11bd74600d74 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:56.383108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef82092-5939-4cf5-a29c-11bd74600d74 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:56.424351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f12a-a739-45d2-b501-d3a8469204bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:56.425323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f12a-a739-45d2-b501-d3a8469204bd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:56.425840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f12a-a739-45d2-b501-d3a8469204bd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:56.426339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f12a-a739-45d2-b501-d3a8469204bd None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:56.427688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f12a-a739-45d2-b501-d3a8469204bd None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:56.429387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f12a-a739-45d2-b501-d3a8469204bd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:56.431758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 157/317] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 00:59:56 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:56.438655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368602-165d-4a60-b9fa-c4dcb325d698 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:56.548808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79368602-165d-4a60-b9fa-c4dcb325d698 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:56.577964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:56.587270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927e422-1500-4482-a1ef-4fc3960e6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:56.588200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927e422-1500-4482-a1ef-4fc3960e6d79 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:56.588782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927e422-1500-4482-a1ef-4fc3960e6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:56.589256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927e422-1500-4482-a1ef-4fc3960e6d79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:56.590357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927e422-1500-4482-a1ef-4fc3960e6d79 None admin] RBAC: Adding query filter params (role.id=825bce4bc5ec40e8ba620d6514237e48, scope.project.id=c74b7a27d82349698d162ee8c4036e4b, user.id=c69326a6620844f2b5c586250aa1ae2d) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:56.590873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927e422-1500-4482-a1ef-4fc3960e6d79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:56.592499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927e422-1500-4482-a1ef-4fc3960e6d79 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:56.600048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 161/318] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 00:59:56 2022] GET /identity/v3/role_assignments?user.id=c69326a6620844f2b5c586250aa1ae2d&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=825bce4bc5ec40e8ba620d6514237e48 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:57.176015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15af62-7d82-4b1f-b584-83bc3d4e65d8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:57.176390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15af62-7d82-4b1f-b584-83bc3d4e65d8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:57.176576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15af62-7d82-4b1f-b584-83bc3d4e65d8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:57.178107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 158/319] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:57.183182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedbf69-0819-464a-9249-b2e7a4203644 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:57.183477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedbf69-0819-464a-9249-b2e7a4203644 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:57.183748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedbf69-0819-464a-9249-b2e7a4203644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:57.201967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6cedbf69-0819-464a-9249-b2e7a4203644 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:57.204561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6cedbf69-0819-464a-9249-b2e7a4203644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:57.271311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 162/320] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:57.499384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af3681-0b02-4594-a7aa-d18599811811 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:57.500363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af3681-0b02-4594-a7aa-d18599811811 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:57.500363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af3681-0b02-4594-a7aa-d18599811811 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:57.501906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 159/321] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:57.508387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6178a-c042-45f1-936b-e1c3374068cc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:57.508684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6178a-c042-45f1-936b-e1c3374068cc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:57.508962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6178a-c042-45f1-936b-e1c3374068cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:57.527980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b2f6178a-c042-45f1-936b-e1c3374068cc None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:57.529162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b2f6178a-c042-45f1-936b-e1c3374068cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:57.543414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af3681-0b02-4594-a7aa-d18599811811 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:57.601445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 163/322] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 00:59:57.620175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:57.656216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af3681-0b02-4594-a7aa-d18599811811 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:57.690825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8316fe-a2b5-4bac-a82d-1c3b905d6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:57.691461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8316fe-a2b5-4bac-a82d-1c3b905d6d1c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:57.691745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8316fe-a2b5-4bac-a82d-1c3b905d6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:57.692023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8316fe-a2b5-4bac-a82d-1c3b905d6d1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:57.693121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8316fe-a2b5-4bac-a82d-1c3b905d6d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:57.694594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8316fe-a2b5-4bac-a82d-1c3b905d6d1c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:57.696325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 160/323] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 00:59:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:57.701665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6178a-c042-45f1-936b-e1c3374068cc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:57.754311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:57.803082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6178a-c042-45f1-936b-e1c3374068cc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:57.836613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c59ced-2415-49b4-b5e0-285c52534192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:57.837230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c59ced-2415-49b4-b5e0-285c52534192 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:57.837540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c59ced-2415-49b4-b5e0-285c52534192 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:57.837815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c59ced-2415-49b4-b5e0-285c52534192 None admin] PATH_INFO: `/v3/groups` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:57.838487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c59ced-2415-49b4-b5e0-285c52534192 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:57.840037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c59ced-2415-49b4-b5e0-285c52534192 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:57.856800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 164/324] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Sep 8 00:59:57 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 00:59:57.876987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8316fe-a2b5-4bac-a82d-1c3b905d6d1c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:57.985607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8316fe-a2b5-4bac-a82d-1c3b905d6d1c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:58.022273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15304c-5cea-4c98-be59-43d718115a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:58.025712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15304c-5cea-4c98-be59-43d718115a49 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:58.025712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15304c-5cea-4c98-be59-43d718115a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:58.025712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15304c-5cea-4c98-be59-43d718115a49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:58.028976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:58.037956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15304c-5cea-4c98-be59-43d718115a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2d15304c-5cea-4c98-be59-43d718115a49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:58.043362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:58.044224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:58.044984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 161/325] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:58.050431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c59ced-2415-49b4-b5e0-285c52534192 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:58.165246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c59ced-2415-49b4-b5e0-285c52534192 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:58.181465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:58.205206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:58.205896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:58.209821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:58.209821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:58.209821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:58.209821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:58.209821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:58.218880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 165/326] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:58.225057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15304c-5cea-4c98-be59-43d718115a49 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:58.341480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15304c-5cea-4c98-be59-43d718115a49 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:58.384447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13559b5e-3ca6-4a2d-9dd7-4dda8bc528b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:58.385563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559b5e-3ca6-4a2d-9dd7-4dda8bc528b5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:58.386050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559b5e-3ca6-4a2d-9dd7-4dda8bc528b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:58.386527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559b5e-3ca6-4a2d-9dd7-4dda8bc528b5 None admin] PATH_INFO: `/v3/users/35bb9840941c4ba8936399d878f378a2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:58.388173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13559b5e-3ca6-4a2d-9dd7-4dda8bc528b5 None admin] RBAC: Authorizing `identity:get_user(user_id=35bb9840941c4ba8936399d878f378a2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:58.389672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13559b5e-3ca6-4a2d-9dd7-4dda8bc528b5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:58.391651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 162/327] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:58 2022] GET /identity/v3/users/35bb9840941c4ba8936399d878f378a2 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:58.397155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:58.398905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df86d-d343-4b57-8698-a930f27d8eb4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:58.399193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df86d-d343-4b57-8698-a930f27d8eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:58.399469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05df86d-d343-4b57-8698-a930f27d8eb4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:58.400908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 163/328] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 00:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 00:59:58.409942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5f582-1aef-46b9-be4b-1aaaa05c6749 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:58.410242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5f582-1aef-46b9-be4b-1aaaa05c6749 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:58.410509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5f582-1aef-46b9-be4b-1aaaa05c6749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:58.436961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2bd5f582-1aef-46b9-be4b-1aaaa05c6749 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 00:59:58.438872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2bd5f582-1aef-46b9-be4b-1aaaa05c6749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 00:59:58.505791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:58.513974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 164/329] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 00:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 00:59:58.535919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba51e3-8af6-4bdb-8e2a-29e9f6d69b7a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:58.574479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19ff2-5a32-4a75-bd3d-f2655a12d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:58.575137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19ff2-5a32-4a75-bd3d-f2655a12d264 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:58.575419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19ff2-5a32-4a75-bd3d-f2655a12d264 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:58.575695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19ff2-5a32-4a75-bd3d-f2655a12d264 None admin] PATH_INFO: `/v3/system/users/35bb9840941c4ba8936399d878f378a2/roles/825bce4bc5ec40e8ba620d6514237e48` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:58.577177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce19ff2-5a32-4a75-bd3d-f2655a12d264 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=35bb9840941c4ba8936399d878f378a2, role_id=825bce4bc5ec40e8ba620d6514237e48)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:58.578669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce19ff2-5a32-4a75-bd3d-f2655a12d264 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:58.591001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 166/330] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Sep 8 00:59:58 2022] PUT /identity/v3/system/users/35bb9840941c4ba8936399d878f378a2/roles/825bce4bc5ec40e8ba620d6514237e48 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 00:59:58.796201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5f582-1aef-46b9-be4b-1aaaa05c6749 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:58.932827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5f582-1aef-46b9-be4b-1aaaa05c6749 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:58.984148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933d4c1-9e40-4984-a956-2c156516e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:58.984797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933d4c1-9e40-4984-a956-2c156516e86a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:58.985127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933d4c1-9e40-4984-a956-2c156516e86a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:58.985420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933d4c1-9e40-4984-a956-2c156516e86a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:59.000396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933d4c1-9e40-4984-a956-2c156516e86a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8933d4c1-9e40-4984-a956-2c156516e86a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 00:59:59.005574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 00:59:59.007013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 00:59:59.007768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 00:59:59.011380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 165/331] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 00:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 00:59:59.019922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19ff2-5a32-4a75-bd3d-f2655a12d264 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:59.072329 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:59.164144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19ff2-5a32-4a75-bd3d-f2655a12d264 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:59.208957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:59.209980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:59.210465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:59.210938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:59.211806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:59.212323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:59.213936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:59.229206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 167/332] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 00:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:59.235431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933d4c1-9e40-4984-a956-2c156516e86a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:59.315259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:59.376174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933d4c1-9e40-4984-a956-2c156516e86a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:59.420041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df0c6c-7616-4851-b6c2-df0b4f1b3b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:59.420674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0c6c-7616-4851-b6c2-df0b4f1b3b35 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:59.420951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0c6c-7616-4851-b6c2-df0b4f1b3b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:59.421225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0c6c-7616-4851-b6c2-df0b4f1b3b35 None admin] PATH_INFO: `/v3/users/9ac97011100b44d5906a751b80822419` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:59.422993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df0c6c-7616-4851-b6c2-df0b4f1b3b35 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac97011100b44d5906a751b80822419)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:59.424431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df0c6c-7616-4851-b6c2-df0b4f1b3b35 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:59.426432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 166/333] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 00:59:59 2022] GET /identity/v3/users/9ac97011100b44d5906a751b80822419 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 00:59:59.432180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 00:59:59.579823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 00:59:59.582762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9039fa-9b30-4574-9182-01f4371f6aa4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 00:59:59.626324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424810d-acfb-47b2-b775-c460bb5d3a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 00:59:59.626863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424810d-acfb-47b2-b775-c460bb5d3a7b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 00:59:59.627144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424810d-acfb-47b2-b775-c460bb5d3a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 00:59:59.627415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424810d-acfb-47b2-b775-c460bb5d3a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 00:59:59.628142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424810d-acfb-47b2-b775-c460bb5d3a7b None admin] RBAC: Adding query filter params (role.id=193a2ccbf16642a0af3edc128493946e, user.id=9ac97011100b44d5906a751b80822419, scope.system=all) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 00:59:59.628452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424810d-acfb-47b2-b775-c460bb5d3a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 00:59:59.629948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424810d-acfb-47b2-b775-c460bb5d3a7b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 00:59:59.648928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 168/334] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Sep 8 00:59:59 2022] GET /identity/v3/role_assignments?user.id=9ac97011100b44d5906a751b80822419&scope.system=all&role.id=193a2ccbf16642a0af3edc128493946e => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:00.851232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c650e-9b51-4406-aea4-b5209823844a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:00.852084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c650e-9b51-4406-aea4-b5209823844a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:00.852522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c650e-9b51-4406-aea4-b5209823844a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:00.854300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 167/335] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:00.860265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b86d82-b033-42f8-902b-b5350662abe5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:00.861177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b86d82-b033-42f8-902b-b5350662abe5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:00.861687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b86d82-b033-42f8-902b-b5350662abe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:00.890650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b3b86d82-b033-42f8-902b-b5350662abe5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:00.892250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b3b86d82-b033-42f8-902b-b5350662abe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:00.973906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 169/336] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:01.134324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b58f0c-efc9-41fa-8b09-2fb7f8295698 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:01.134940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b58f0c-efc9-41fa-8b09-2fb7f8295698 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:01.135459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b58f0c-efc9-41fa-8b09-2fb7f8295698 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:01.137257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 168/337] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:01.143007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da0ac-a264-477a-963d-141422c752d4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:01.143538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da0ac-a264-477a-963d-141422c752d4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:01.144006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da0ac-a264-477a-963d-141422c752d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:01.174399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f76da0ac-a264-477a-963d-141422c752d4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:01.175971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f76da0ac-a264-477a-963d-141422c752d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:01.262711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 170/338] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 01:00:01.299716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b58f0c-efc9-41fa-8b09-2fb7f8295698 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:01.417715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b58f0c-efc9-41fa-8b09-2fb7f8295698 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:01.443543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:01.457008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19bfa0-691a-4d6e-b24a-36466927584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:01.458026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19bfa0-691a-4d6e-b24a-36466927584f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:01.458509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19bfa0-691a-4d6e-b24a-36466927584f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:01.458983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19bfa0-691a-4d6e-b24a-36466927584f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:01.476203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19bfa0-691a-4d6e-b24a-36466927584f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fa19bfa0-691a-4d6e-b24a-36466927584f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:01.481482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:01.482329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:01.483100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:01.485883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 169/339] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:01.491744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da0ac-a264-477a-963d-141422c752d4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:01.521877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:01.614151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da0ac-a264-477a-963d-141422c752d4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:01.662120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:01.662744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:01.663029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:01.663308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:01.663983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:01.664287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:01.665689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:01.674805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 171/340] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 01:00:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:01.680351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19bfa0-691a-4d6e-b24a-36466927584f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:01.805239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19bfa0-691a-4d6e-b24a-36466927584f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:01.848636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2200-ade2-4f70-a5df-d00e1e147693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:01.849268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2200-ade2-4f70-a5df-d00e1e147693 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:01.849664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2200-ade2-4f70-a5df-d00e1e147693 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:01.849949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2200-ade2-4f70-a5df-d00e1e147693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:01.917639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:01.941350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e2200-ade2-4f70-a5df-d00e1e147693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:01.942790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e2200-ade2-4f70-a5df-d00e1e147693 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:02.005779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:02.059552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 170/341] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:02.065519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2200-ade2-4f70-a5df-d00e1e147693 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:02.157853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:02.175261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2200-ade2-4f70-a5df-d00e1e147693 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:02.188601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:02.224368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f9f44-3a97-4363-929b-44d928313c32 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:02.232488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4249-7186-4092-bef9-bbe107da185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:02.233186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4249-7186-4092-bef9-bbe107da185f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.233552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4249-7186-4092-bef9-bbe107da185f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.234410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4249-7186-4092-bef9-bbe107da185f None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.235566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4249-7186-4092-bef9-bbe107da185f None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:02.237014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4249-7186-4092-bef9-bbe107da185f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:02.244021 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 171/342] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:02 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:02.245395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938549-b392-401f-833b-42455added22 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.245699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938549-b392-401f-833b-42455added22 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.245975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938549-b392-401f-833b-42455added22 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.247977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 172/343] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:02.249317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee938549-b392-401f-833b-42455added22 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:02.288683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3890f38-c1bc-4bcf-829a-5bb023665c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:02.289607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3890f38-c1bc-4bcf-829a-5bb023665c1f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.290036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3890f38-c1bc-4bcf-829a-5bb023665c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.290460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3890f38-c1bc-4bcf-829a-5bb023665c1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.303640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3890f38-c1bc-4bcf-829a-5bb023665c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e3890f38-c1bc-4bcf-829a-5bb023665c1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:02.309206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:02.310199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:02.310975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:02.314448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 172/344] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:00:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:02.314448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0783-b3f1-4775-9f2c-2d5e097c70fc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.314448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0783-b3f1-4775-9f2c-2d5e097c70fc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.314448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0783-b3f1-4775-9f2c-2d5e097c70fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.336157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-145d0783-b3f1-4775-9f2c-2d5e097c70fc None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:02.337366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-145d0783-b3f1-4775-9f2c-2d5e097c70fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:02.408343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee938549-b392-401f-833b-42455added22 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:02.419237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 173/345] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:02.420733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ebd8-db24-4e9d-b9ae-7871524bf5f8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.421202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ebd8-db24-4e9d-b9ae-7871524bf5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.421638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ebd8-db24-4e9d-b9ae-7871524bf5f8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.423047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 174/346] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:02.423941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ebd8-db24-4e9d-b9ae-7871524bf5f8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:02.449562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cbe6a-3a4c-4cc7-8206-2b4b72e3404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:02.450198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbe6a-3a4c-4cc7-8206-2b4b72e3404b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.450642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbe6a-3a4c-4cc7-8206-2b4b72e3404b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.451062 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cbe6a-3a4c-4cc7-8206-2b4b72e3404b None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.457847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cbe6a-3a4c-4cc7-8206-2b4b72e3404b None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:02.459532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cbe6a-3a4c-4cc7-8206-2b4b72e3404b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:02.461314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 173/347] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:02 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:02.462683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4a949-5c1c-49f7-a154-883030b73222 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.463148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4a949-5c1c-49f7-a154-883030b73222 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.463622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4a949-5c1c-49f7-a154-883030b73222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.486388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8bf4a949-5c1c-49f7-a154-883030b73222 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:02.488658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8bf4a949-5c1c-49f7-a154-883030b73222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:02.498698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:02.529451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:02.568942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ebd8-db24-4e9d-b9ae-7871524bf5f8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:02.569857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 174/348] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:02.571272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ff116-cf7e-4c97-ba6c-489ada57a772 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.571706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ff116-cf7e-4c97-ba6c-489ada57a772 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.572164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ff116-cf7e-4c97-ba6c-489ada57a772 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.573831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 175/349] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:02.574667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ff116-cf7e-4c97-ba6c-489ada57a772 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:02.629821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8a9c8-629e-495c-9759-3145bf682386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:02.630516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8a9c8-629e-495c-9759-3145bf682386 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.631038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8a9c8-629e-495c-9759-3145bf682386 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.631318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8a9c8-629e-495c-9759-3145bf682386 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.631981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8a9c8-629e-495c-9759-3145bf682386 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:02.632280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8a9c8-629e-495c-9759-3145bf682386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:02.634426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8a9c8-629e-495c-9759-3145bf682386 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:02.655071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 175/350] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:02.657565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eff2b-2417-4726-bb5a-f47485a5696b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.658803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eff2b-2417-4726-bb5a-f47485a5696b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.659962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eff2b-2417-4726-bb5a-f47485a5696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.700724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-434eff2b-2417-4726-bb5a-f47485a5696b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:02.700724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-434eff2b-2417-4726-bb5a-f47485a5696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:02.730429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ff116-cf7e-4c97-ba6c-489ada57a772 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:02.793334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:02.794138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:02.794420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:02.794693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:02.797921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] RBAC: Adding query filter params (group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=e24b490d9d7146659455e535a333fad2) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:02.797921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:02.798186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:02.807298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 176/351] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:02 2022] GET /identity/v3/role_assignments?group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=193a2ccbf16642a0af3edc128493946e => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:02.809637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:02.837659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 176/352] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:02.839035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434eff2b-2417-4726-bb5a-f47485a5696b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:02.853053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:02.982802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:03.054887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434eff2b-2417-4726-bb5a-f47485a5696b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:03.059449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4783-883c-4da3-91b8-a3d58eb1efae None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:03.104973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8037da9-e188-4090-aebd-ea920723ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:03.105311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429bf01-774b-410a-b93b-67d3d61dd792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:03.105669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8037da9-e188-4090-aebd-ea920723ee88 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.105887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429bf01-774b-410a-b93b-67d3d61dd792 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.106002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8037da9-e188-4090-aebd-ea920723ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.106155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429bf01-774b-410a-b93b-67d3d61dd792 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.106243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8037da9-e188-4090-aebd-ea920723ee88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.106426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429bf01-774b-410a-b93b-67d3d61dd792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.120517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8037da9-e188-4090-aebd-ea920723ee88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a8037da9-e188-4090-aebd-ea920723ee88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:03.127637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:03.128562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:03.129346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 177/353] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:03.134812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8037da9-e188-4090-aebd-ea920723ee88 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:03.240293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429bf01-774b-410a-b93b-67d3d61dd792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:03.241866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429bf01-774b-410a-b93b-67d3d61dd792 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:03.256165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:03.299591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8037da9-e188-4090-aebd-ea920723ee88 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:03.328093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:03.341285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9662f-be19-4c8f-be45-6e2e17cbfe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:03.341952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9662f-be19-4c8f-be45-6e2e17cbfe88 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.342233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9662f-be19-4c8f-be45-6e2e17cbfe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.342508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9662f-be19-4c8f-be45-6e2e17cbfe88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.354259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9662f-be19-4c8f-be45-6e2e17cbfe88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-57f9662f-be19-4c8f-be45-6e2e17cbfe88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:03.359222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:03.360087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:03.360900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 178/354] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:03.361580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9662f-be19-4c8f-be45-6e2e17cbfe88 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:03.371832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 177/355] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:03.372770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429bf01-774b-410a-b93b-67d3d61dd792 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:03.491839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9662f-be19-4c8f-be45-6e2e17cbfe88 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:03.502161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429bf01-774b-410a-b93b-67d3d61dd792 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:03.519056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:03.536287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7db4a-8b8e-485d-978c-aeda6dd5eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:03.536523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7db4a-8b8e-485d-978c-aeda6dd5eb86 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.536917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7db4a-8b8e-485d-978c-aeda6dd5eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.537163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7db4a-8b8e-485d-978c-aeda6dd5eb86 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.538364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7db4a-8b8e-485d-978c-aeda6dd5eb86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:03.538364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7db4a-8b8e-485d-978c-aeda6dd5eb86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:03.539461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7db4a-8b8e-485d-978c-aeda6dd5eb86 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:03.548762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 179/356] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 01:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:03.550042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c031a3-d69d-45bc-b031-604f692fdb39 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.550333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c031a3-d69d-45bc-b031-604f692fdb39 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.550612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c031a3-d69d-45bc-b031-604f692fdb39 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.551834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 180/357] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:03.552532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c031a3-d69d-45bc-b031-604f692fdb39 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:03.554752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dff8f-f5c7-4bd6-a82e-8d1d7d26b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:03.555383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dff8f-f5c7-4bd6-a82e-8d1d7d26b85a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.555662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dff8f-f5c7-4bd6-a82e-8d1d7d26b85a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.555937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dff8f-f5c7-4bd6-a82e-8d1d7d26b85a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.572811 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dff8f-f5c7-4bd6-a82e-8d1d7d26b85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ec7dff8f-f5c7-4bd6-a82e-8d1d7d26b85a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:03.578444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:03.579331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:03.580170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 178/358] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:00:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:03.580825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dff8f-f5c7-4bd6-a82e-8d1d7d26b85a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:03.615993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:03.680949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c031a3-d69d-45bc-b031-604f692fdb39 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:03.711285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dff8f-f5c7-4bd6-a82e-8d1d7d26b85a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:03.716603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:03.717214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.717537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.718943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.719618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:03.719920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:03.721312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:03.734515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 181/359] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 01:00:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:03.735439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:03.757490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa1764-6579-4a8a-be6b-7703ec72e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:03.758568 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa1764-6579-4a8a-be6b-7703ec72e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.759048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa1764-6579-4a8a-be6b-7703ec72e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.759521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa1764-6579-4a8a-be6b-7703ec72e7f7 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.761053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa1764-6579-4a8a-be6b-7703ec72e7f7 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:03.763508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa1764-6579-4a8a-be6b-7703ec72e7f7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:03.766045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 179/360] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:03 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:03.767206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c8a1-b682-42d5-9d58-d74559ee3d72 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.767489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c8a1-b682-42d5-9d58-d74559ee3d72 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.767768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8c8a1-b682-42d5-9d58-d74559ee3d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.788838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8bd8c8a1-b682-42d5-9d58-d74559ee3d72 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:03.790381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8bd8c8a1-b682-42d5-9d58-d74559ee3d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:03.828935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:03.855421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53509dd-ced1-4f4f-aa16-94bcc69e8e70 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:03.864332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:03.882953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 180/361] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:03.884247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c8a1-b682-42d5-9d58-d74559ee3d72 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:03.897883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638784a5-2109-4359-9b77-76bd4fa8ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:03.899241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638784a5-2109-4359-9b77-76bd4fa8ef5a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:03.899670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638784a5-2109-4359-9b77-76bd4fa8ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:03.900431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638784a5-2109-4359-9b77-76bd4fa8ef5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:03.972875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638784a5-2109-4359-9b77-76bd4fa8ef5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:03.974633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638784a5-2109-4359-9b77-76bd4fa8ef5a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:04.001381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8c8a1-b682-42d5-9d58-d74559ee3d72 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:04.051939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:04.052938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:04.053684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:04.054128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:04.054933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:04.055379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:04.057857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:04.068280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 181/362] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:04.073890 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.107879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 182/363] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:04.109440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638784a5-2109-4359-9b77-76bd4fa8ef5a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.114690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:04.120312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:04.215594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baf387-1b01-4110-b899-eea5d6c75f3a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:04.237864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638784a5-2109-4359-9b77-76bd4fa8ef5a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:04.266433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35d33-a8e2-442f-8504-fd32c1b96741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:04.267079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35d33-a8e2-442f-8504-fd32c1b96741 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:04.267361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35d33-a8e2-442f-8504-fd32c1b96741 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:04.267636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35d33-a8e2-442f-8504-fd32c1b96741 None admin] PATH_INFO: `/v3/users/35bb9840941c4ba8936399d878f378a2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:04.268822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c35d33-a8e2-442f-8504-fd32c1b96741 None admin] RBAC: Authorizing `identity:get_user(user_id=35bb9840941c4ba8936399d878f378a2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:04.270316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c35d33-a8e2-442f-8504-fd32c1b96741 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:04.272140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 182/364] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/users/35bb9840941c4ba8936399d878f378a2 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:04.272699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35d33-a8e2-442f-8504-fd32c1b96741 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.295508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249df477-1673-404c-91bd-d2d701437c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:04.296150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df477-1673-404c-91bd-d2d701437c26 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:04.296968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df477-1673-404c-91bd-d2d701437c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:04.297244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df477-1673-404c-91bd-d2d701437c26 None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:04.298869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249df477-1673-404c-91bd-d2d701437c26 None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:04.300346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249df477-1673-404c-91bd-d2d701437c26 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:04.302146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 183/365] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:04.303053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249df477-1673-404c-91bd-d2d701437c26 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.398940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:04.399920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:04.411191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35d33-a8e2-442f-8504-fd32c1b96741 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:04.432115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249df477-1673-404c-91bd-d2d701437c26 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:04.458847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028f1c7-823e-4584-b6d7-4914f039dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:04.459490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f1c7-823e-4584-b6d7-4914f039dce3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:04.459750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f1c7-823e-4584-b6d7-4914f039dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:04.460027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f1c7-823e-4584-b6d7-4914f039dce3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:04.478794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed244f9f-3e36-4246-bb1e-55b56810c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:04.479681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed244f9f-3e36-4246-bb1e-55b56810c066 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:04.479791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed244f9f-3e36-4246-bb1e-55b56810c066 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:04.480113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed244f9f-3e36-4246-bb1e-55b56810c066 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:04.481301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed244f9f-3e36-4246-bb1e-55b56810c066 None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:04.482909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed244f9f-3e36-4246-bb1e-55b56810c066 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:04.489614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:04.490473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed244f9f-3e36-4246-bb1e-55b56810c066 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.555899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028f1c7-823e-4584-b6d7-4914f039dce3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:04.557358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028f1c7-823e-4584-b6d7-4914f039dce3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:04.619234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed244f9f-3e36-4246-bb1e-55b56810c066 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:04.668273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ad5b4-fbe7-4dd6-81bf-fd4b5d905c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:04.668835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad5b4-fbe7-4dd6-81bf-fd4b5d905c1d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:04.669116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad5b4-fbe7-4dd6-81bf-fd4b5d905c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:04.669383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad5b4-fbe7-4dd6-81bf-fd4b5d905c1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:04.682836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ad5b4-fbe7-4dd6-81bf-fd4b5d905c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:04.688862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f75ad5b4-fbe7-4dd6-81bf-fd4b5d905c1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:04.689820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:04.690953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 185/367] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:04.692032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ad5b4-fbe7-4dd6-81bf-fd4b5d905c1d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.695990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:04.704552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 183/368] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:04.705477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028f1c7-823e-4584-b6d7-4914f039dce3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.829070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ad5b4-fbe7-4dd6-81bf-fd4b5d905c1d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:04.833947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028f1c7-823e-4584-b6d7-4914f039dce3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:04.878925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:04.879618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:04.879935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:04.880167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:04.880892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] RBAC: Adding query filter params (role.id=825bce4bc5ec40e8ba620d6514237e48, user.id=35bb9840941c4ba8936399d878f378a2, scope.system=all) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:04.881197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:04.883292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:04.883430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:04.884260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:04.884756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:04.885232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:04.886247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] RBAC: Adding query filter params (group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role.id=72b0245082944533beab3a422c3c640a, scope.project.id=e24b490d9d7146659455e535a333fad2) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:04.886770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:04.889112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:04.895944 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 186/369] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/role_assignments?user.id=35bb9840941c4ba8936399d878f378a2&scope.system=all&role.id=825bce4bc5ec40e8ba620d6514237e48 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:04.896467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 184/370] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/role_assignments?group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=72b0245082944533beab3a422c3c640a => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:04.896652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.901548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:04.977895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:05.018785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849daee-5ca3-423f-90f6-f61d20cec7a9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:05.057517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:05.062503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78850dd-0494-416c-8a9b-6a9924ac5e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:05.063438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78850dd-0494-416c-8a9b-6a9924ac5e5d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.063986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78850dd-0494-416c-8a9b-6a9924ac5e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.064405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78850dd-0494-416c-8a9b-6a9924ac5e5d None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.065855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78850dd-0494-416c-8a9b-6a9924ac5e5d None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:05.067487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78850dd-0494-416c-8a9b-6a9924ac5e5d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:05.073651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 187/371] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:05.074881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78850dd-0494-416c-8a9b-6a9924ac5e5d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:05.155855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674239-7380-4ac6-8de4-aec649dee4a9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:05.198361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78850dd-0494-416c-8a9b-6a9924ac5e5d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:05.228367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:05.228928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.229448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:05.230160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.230633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.231353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:05.231804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:05.233317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:05.242631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9d13-aa52-47af-b10c-1ca93a86839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:05.243436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9d13-aa52-47af-b10c-1ca93a86839c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.243725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9d13-aa52-47af-b10c-1ca93a86839c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.244052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9d13-aa52-47af-b10c-1ca93a86839c None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.245344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9d13-aa52-47af-b10c-1ca93a86839c None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:05.246962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 185/372] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:05.247599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:05.248695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9d13-aa52-47af-b10c-1ca93a86839c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:05.251284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 188/373] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:05 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:05.257679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9d13-aa52-47af-b10c-1ca93a86839c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:05.378907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee2992-c050-4e21-bc6a-3add7b0a64be None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:05.404031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9d13-aa52-47af-b10c-1ca93a86839c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:05.405153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:05.420757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:05.421554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.421841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.422465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.422853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] RBAC: Adding query filter params (group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=c74b7a27d82349698d162ee8c4036e4b) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:05.423254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:05.424582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:05.430664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 186/374] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:05 2022] GET /identity/v3/role_assignments?group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=193a2ccbf16642a0af3edc128493946e => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:05.431475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:05.449139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f018ae-0522-445d-91d0-ced66f4948a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:05.450487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f018ae-0522-445d-91d0-ced66f4948a0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.450991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f018ae-0522-445d-91d0-ced66f4948a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.451749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f018ae-0522-445d-91d0-ced66f4948a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.547164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:05.557235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f018ae-0522-445d-91d0-ced66f4948a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:05.559034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f018ae-0522-445d-91d0-ced66f4948a0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:05.560254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ee77f-7f68-419e-8090-e69950376d04 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:05.604526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1920e-1d4d-4c9e-b0d3-b8a9a114701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:05.605772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1920e-1d4d-4c9e-b0d3-b8a9a114701e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.606380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1920e-1d4d-4c9e-b0d3-b8a9a114701e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.606858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1920e-1d4d-4c9e-b0d3-b8a9a114701e None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.608409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1920e-1d4d-4c9e-b0d3-b8a9a114701e None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:05.610207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1920e-1d4d-4c9e-b0d3-b8a9a114701e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:05.613096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 187/375] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:05 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:05.614749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31635d-c219-4e28-bd2f-1f33d2334927 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.615257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31635d-c219-4e28-bd2f-1f33d2334927 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.615836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31635d-c219-4e28-bd2f-1f33d2334927 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.617760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 188/376] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:05.624043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3e46-697d-4f0d-acb0-16a703436d18 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.625290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3e46-697d-4f0d-acb0-16a703436d18 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.625795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3e46-697d-4f0d-acb0-16a703436d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.648045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9fec3e46-697d-4f0d-acb0-16a703436d18 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:05.649913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9fec3e46-697d-4f0d-acb0-16a703436d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:05.691934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 189/377] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:05.692870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f018ae-0522-445d-91d0-ced66f4948a0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:05.722002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:05.743712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 189/378] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:05.744881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3e46-697d-4f0d-acb0-16a703436d18 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:05.805895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:05.815163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f018ae-0522-445d-91d0-ced66f4948a0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:05.863307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:05.864288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.864966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.866078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.867831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] RBAC: Adding query filter params (group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role.id=72b0245082944533beab3a422c3c640a, scope.project.id=c74b7a27d82349698d162ee8c4036e4b) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:05.868523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:05.871413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:05.872431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3e46-697d-4f0d-acb0-16a703436d18 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:05.886814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 190/379] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:05 2022] GET /identity/v3/role_assignments?group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=72b0245082944533beab3a422c3c640a => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:05.919558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf8046-2db2-42fe-8ac4-ca2a177ae19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:05.920620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8046-2db2-42fe-8ac4-ca2a177ae19a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:05.921692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8046-2db2-42fe-8ac4-ca2a177ae19a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:05.922182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8046-2db2-42fe-8ac4-ca2a177ae19a None admin] PATH_INFO: `/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:05.926237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf8046-2db2-42fe-8ac4-ca2a177ae19a None admin] RBAC: Authorizing `identity:get_project(project_id=f1a2335b6b0e4e3b94d114442755e8d9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:05.928043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf8046-2db2-42fe-8ac4-ca2a177ae19a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:05.930063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 190/380] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:05 2022] GET /identity/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:05.936192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:06.069629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9492d2-238e-4739-bee5-fd2d75da52d9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:06.099727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf8046-2db2-42fe-8ac4-ca2a177ae19a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:06.114265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ded5-22a0-4c8f-ae4d-33edcf014942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:06.114900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ded5-22a0-4c8f-ae4d-33edcf014942 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:06.115177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ded5-22a0-4c8f-ae4d-33edcf014942 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:06.115444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0ded5-22a0-4c8f-ae4d-33edcf014942 None admin] PATH_INFO: `/v3/groups/5582a78051fa4498a86db67469dc2d30` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:06.122794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0ded5-22a0-4c8f-ae4d-33edcf014942 None admin] RBAC: Authorizing `identity:get_group(group_id=5582a78051fa4498a86db67469dc2d30)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:06.124914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0ded5-22a0-4c8f-ae4d-33edcf014942 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:06.127356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 191/381] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:05 2022] GET /identity/v3/groups/5582a78051fa4498a86db67469dc2d30 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:06.134544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ded5-22a0-4c8f-ae4d-33edcf014942 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:06.175390 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:06.232558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:06.308373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0ded5-22a0-4c8f-ae4d-33edcf014942 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:06.315964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf8046-2db2-42fe-8ac4-ca2a177ae19a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:06.361525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:06.362081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:06.362362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:06.362633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:06.363368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] RBAC: Adding query filter params (group.id=5582a78051fa4498a86db67469dc2d30, role.id=c182619b007b495f912901d866e751e1, scope.project.id=f1a2335b6b0e4e3b94d114442755e8d9) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:06.363679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:06.366296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:06.384060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921d52-b2e0-4e3d-8efe-229e0ada6fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:06.384720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921d52-b2e0-4e3d-8efe-229e0ada6fdb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:06.385008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921d52-b2e0-4e3d-8efe-229e0ada6fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:06.385287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e921d52-b2e0-4e3d-8efe-229e0ada6fdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:06.385389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 192/382] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:06 2022] GET /identity/v3/role_assignments?group.id=5582a78051fa4498a86db67469dc2d30&scope.project.id=f1a2335b6b0e4e3b94d114442755e8d9&role.id=c182619b007b495f912901d866e751e1 => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:06.399679 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e921d52-b2e0-4e3d-8efe-229e0ada6fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1e921d52-b2e0-4e3d-8efe-229e0ada6fdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:06.405303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:06.406704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:06.407904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 191/383] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:06.413635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:06.570121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:06.583238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525b1b-03ef-4b96-b21c-aba17151c1fd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:06.631127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:06.631898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:06.632185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:06.632461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:06.633140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:06.633466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:06.634844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:06.646825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 193/384] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 01:00:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:06.652661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921d52-b2e0-4e3d-8efe-229e0ada6fdb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:06.792208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e921d52-b2e0-4e3d-8efe-229e0ada6fdb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:06.809581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:06.834999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47f04-f407-4cf2-8aee-09513c03b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:06.835637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47f04-f407-4cf2-8aee-09513c03b359 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:06.835917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47f04-f407-4cf2-8aee-09513c03b359 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:06.836236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47f04-f407-4cf2-8aee-09513c03b359 None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:06.837355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a47f04-f407-4cf2-8aee-09513c03b359 None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:06.838908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a47f04-f407-4cf2-8aee-09513c03b359 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:06.840493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 192/385] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:06 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:06.846712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:06.991486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9db34-e517-48c4-ba09-5c150408a3f5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:07.043443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175d713-2b5e-4ee9-9d6f-a9a7a95de389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:07.044454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175d713-2b5e-4ee9-9d6f-a9a7a95de389 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:07.044927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175d713-2b5e-4ee9-9d6f-a9a7a95de389 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:07.045394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175d713-2b5e-4ee9-9d6f-a9a7a95de389 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:07.046856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175d713-2b5e-4ee9-9d6f-a9a7a95de389 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:07.048496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175d713-2b5e-4ee9-9d6f-a9a7a95de389 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:07.050743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 194/386] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:06 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:07.056113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47f04-f407-4cf2-8aee-09513c03b359 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:07.210090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47f04-f407-4cf2-8aee-09513c03b359 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:07.258390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfcc06-bd98-4bdb-951e-0942f5084cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:07.259462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfcc06-bd98-4bdb-951e-0942f5084cac None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:07.259999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfcc06-bd98-4bdb-951e-0942f5084cac None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:07.260581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfcc06-bd98-4bdb-951e-0942f5084cac None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:07.266866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfcc06-bd98-4bdb-951e-0942f5084cac None admin] RBAC: Authorizing `identity:create_grant(project_id=e24b490d9d7146659455e535a333fad2, group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:07.268331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfcc06-bd98-4bdb-951e-0942f5084cac None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:07.288581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 193/387] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 8 01:00:07 2022] PUT /identity/v3/projects/e24b490d9d7146659455e535a333fad2/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:07.795970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c4c0-6bf3-487e-befd-c647c6146931 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:07.797084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c4c0-6bf3-487e-befd-c647c6146931 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:07.797084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c4c0-6bf3-487e-befd-c647c6146931 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:07.798481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 195/388] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:07.804362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b050c8b-5ba9-4374-9cc9-b166afb30cb3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:07.804788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b050c8b-5ba9-4374-9cc9-b166afb30cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:07.805199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b050c8b-5ba9-4374-9cc9-b166afb30cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:07.834443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1b050c8b-5ba9-4374-9cc9-b166afb30cb3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:07.835658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1b050c8b-5ba9-4374-9cc9-b166afb30cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:07.892698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:07.934596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 194/389] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:08.082753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bbd4-c595-40db-95a7-b5e4c77035de None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:08.082936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bbd4-c595-40db-95a7-b5e4c77035de None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:08.083216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bbd4-c595-40db-95a7-b5e4c77035de None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:08.084835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 196/390] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:08.090007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08fd15-d94e-4388-98e0-5b5b9e691401 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:08.090293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08fd15-d94e-4388-98e0-5b5b9e691401 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:08.090567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08fd15-d94e-4388-98e0-5b5b9e691401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:08.112442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2c08fd15-d94e-4388-98e0-5b5b9e691401 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:08.113855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2c08fd15-d94e-4388-98e0-5b5b9e691401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:08.215243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 195/391] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:08.364217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771bbd4-c595-40db-95a7-b5e4c77035de None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:08.390440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:08.497675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771bbd4-c595-40db-95a7-b5e4c77035de None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:08.547171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9862-59f7-42f9-be73-bfbb1c68b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:08.547867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9862-59f7-42f9-be73-bfbb1c68b95e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:08.548149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9862-59f7-42f9-be73-bfbb1c68b95e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:08.548420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9862-59f7-42f9-be73-bfbb1c68b95e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:08.560545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08fd15-d94e-4388-98e0-5b5b9e691401 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:08.563865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9862-59f7-42f9-be73-bfbb1c68b95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-43ff9862-59f7-42f9-be73-bfbb1c68b95e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:08.572059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:08.572982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:08.578222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 197/392] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:00:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:08.580893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9862-59f7-42f9-be73-bfbb1c68b95e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:08.680703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:08.701130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9862-59f7-42f9-be73-bfbb1c68b95e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:08.741447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:08.742503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:08.742989 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:08.743478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:08.744341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:08.744860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:08.747116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:08.757038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 198/393] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:08.763996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:08.803631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:08.807053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08fd15-d94e-4388-98e0-5b5b9e691401 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:08.851072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc4192-a5c9-41f3-b111-44b269e7e3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:08.852205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4192-a5c9-41f3-b111-44b269e7e3eb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:08.852487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4192-a5c9-41f3-b111-44b269e7e3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:08.853050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4192-a5c9-41f3-b111-44b269e7e3eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:08.864422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc4192-a5c9-41f3-b111-44b269e7e3eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5cbc4192-a5c9-41f3-b111-44b269e7e3eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:08.870003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:08.871079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:08.872020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 196/394] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:08.872699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450869b4-911e-408f-85ac-b6467c4eb383 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:08.872962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450869b4-911e-408f-85ac-b6467c4eb383 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:08.873337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450869b4-911e-408f-85ac-b6467c4eb383 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:08.879625 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 197/395] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:08.879625 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450869b4-911e-408f-85ac-b6467c4eb383 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:08.901568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c73758-a6e4-4f57-874d-98cbe779e029 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:08.947360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c4e2b-43b0-4a8b-938a-50ce8e72ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:08.947905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c4e2b-43b0-4a8b-938a-50ce8e72ccbb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:08.948438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c4e2b-43b0-4a8b-938a-50ce8e72ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:08.948719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c4e2b-43b0-4a8b-938a-50ce8e72ccbb None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:08.950064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c4e2b-43b0-4a8b-938a-50ce8e72ccbb None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:08.951516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c4e2b-43b0-4a8b-938a-50ce8e72ccbb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:08.953320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 199/396] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:08 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:08.957732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c4ed-dcbb-4587-b5f0-44f00810aac5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:08.957732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c4ed-dcbb-4587-b5f0-44f00810aac5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:08.957732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c4ed-dcbb-4587-b5f0-44f00810aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:08.987161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-efc7c4ed-dcbb-4587-b5f0-44f00810aac5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:08.988362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-efc7c4ed-dcbb-4587-b5f0-44f00810aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:08.991242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:09.005854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450869b4-911e-408f-85ac-b6467c4eb383 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:09.046962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:09.047572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.047847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.048117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.048784 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:09.049088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:09.050609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:09.064233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 198/397] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 01:00:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:09.064233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:09.091547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:09.092941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 200/398] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:09.094046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7c4ed-dcbb-4587-b5f0-44f00810aac5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:09.211838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7c4ed-dcbb-4587-b5f0-44f00810aac5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:09.248019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b6c2-2e58-4d2b-94f5-8f13c0739b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:09.248898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b6c2-2e58-4d2b-94f5-8f13c0739b48 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.249520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b6c2-2e58-4d2b-94f5-8f13c0739b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.249981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b6c2-2e58-4d2b-94f5-8f13c0739b48 None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.251248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0b6c2-2e58-4d2b-94f5-8f13c0739b48 None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:09.251818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8e19e-c984-4cf0-83b4-54906d085681 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:09.253295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0b6c2-2e58-4d2b-94f5-8f13c0739b48 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:09.255138 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 201/399] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:09 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:09.260658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f75b4f-0c8f-4e80-9295-0e157476ec94 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.261223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f75b4f-0c8f-4e80-9295-0e157476ec94 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.261724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f75b4f-0c8f-4e80-9295-0e157476ec94 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.263692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 202/400] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:09.264669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f75b4f-0c8f-4e80-9295-0e157476ec94 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:09.273874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:09.291095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69673e2-024a-4fe4-bfcf-2f22da92a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:09.292355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69673e2-024a-4fe4-bfcf-2f22da92a747 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.293071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69673e2-024a-4fe4-bfcf-2f22da92a747 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.293641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69673e2-024a-4fe4-bfcf-2f22da92a747 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.295455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69673e2-024a-4fe4-bfcf-2f22da92a747 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:09.297574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69673e2-024a-4fe4-bfcf-2f22da92a747 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:09.300275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 199/401] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:09 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:09.301669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df3e3-92fc-465b-bd1c-1812c317cdc6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.302102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df3e3-92fc-465b-bd1c-1812c317cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.302662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524df3e3-92fc-465b-bd1c-1812c317cdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.325347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-524df3e3-92fc-465b-bd1c-1812c317cdc6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:09.327429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-524df3e3-92fc-465b-bd1c-1812c317cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:09.378691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f75b4f-0c8f-4e80-9295-0e157476ec94 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:09.408895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 200/402] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:09.409978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524df3e3-92fc-465b-bd1c-1812c317cdc6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:09.416765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f120b5b-55df-492b-b498-909425b3b36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:09.417629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120b5b-55df-492b-b498-909425b3b36f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.418058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120b5b-55df-492b-b498-909425b3b36f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.418490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120b5b-55df-492b-b498-909425b3b36f None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.419876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f120b5b-55df-492b-b498-909425b3b36f None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:09.421671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f120b5b-55df-492b-b498-909425b3b36f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:09.423628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 203/403] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:09 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:09.429644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f120b5b-55df-492b-b498-909425b3b36f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:09.441930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:09.541508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524df3e3-92fc-465b-bd1c-1812c317cdc6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:09.543387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:09.574460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f120b5b-55df-492b-b498-909425b3b36f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:09.581071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c392e-18ea-447f-8627-2bc8dde622e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:09.582342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c392e-18ea-447f-8627-2bc8dde622e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.582831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c392e-18ea-447f-8627-2bc8dde622e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.583294 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c392e-18ea-447f-8627-2bc8dde622e6 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28/roles/72b0245082944533beab3a422c3c640a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.585729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c392e-18ea-447f-8627-2bc8dde622e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e24b490d9d7146659455e535a333fad2, group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role_id=72b0245082944533beab3a422c3c640a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:09.587436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c392e-18ea-447f-8627-2bc8dde622e6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:09.604616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 201/404] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 8 01:00:09 2022] PUT /identity/v3/projects/e24b490d9d7146659455e535a333fad2/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28/roles/72b0245082944533beab3a422c3c640a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:09.605993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c392e-18ea-447f-8627-2bc8dde622e6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:09.613791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb312d01-ae2d-4e92-8b45-acf68f9c970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:09.614492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb312d01-ae2d-4e92-8b45-acf68f9c970e None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.614776 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb312d01-ae2d-4e92-8b45-acf68f9c970e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.615050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb312d01-ae2d-4e92-8b45-acf68f9c970e None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.617258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb312d01-ae2d-4e92-8b45-acf68f9c970e None admin] RBAC: Authorizing `identity:create_grant(project_id=c74b7a27d82349698d162ee8c4036e4b, group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:09.619087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb312d01-ae2d-4e92-8b45-acf68f9c970e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:09.650252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 204/405] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 8 01:00:09 2022] PUT /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:00:09.712379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb312d01-ae2d-4e92-8b45-acf68f9c970e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:09.753809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:09.811528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c392e-18ea-447f-8627-2bc8dde622e6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:09.862728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58541aa-a1a5-48cd-91b2-b9e338577aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:09.863815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58541aa-a1a5-48cd-91b2-b9e338577aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.864828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58541aa-a1a5-48cd-91b2-b9e338577aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.865330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58541aa-a1a5-48cd-91b2-b9e338577aa5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.881444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58541aa-a1a5-48cd-91b2-b9e338577aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:09.884725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb312d01-ae2d-4e92-8b45-acf68f9c970e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e58541aa-a1a5-48cd-91b2-b9e338577aa5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:09.889476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:09.890441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:09.891380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:09.894530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 202/406] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:00:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:09.900534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58541aa-a1a5-48cd-91b2-b9e338577aa5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:09.928172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b835b-56a9-4abd-b883-70923e0ca930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:09.928818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b835b-56a9-4abd-b883-70923e0ca930 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:09.929079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b835b-56a9-4abd-b883-70923e0ca930 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:09.929350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b835b-56a9-4abd-b883-70923e0ca930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:09.931396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:09.943492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b835b-56a9-4abd-b883-70923e0ca930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b03b835b-56a9-4abd-b883-70923e0ca930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:09.948811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:09.949779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:09.950572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 205/407] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:09.957911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b835b-56a9-4abd-b883-70923e0ca930 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.067891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58541aa-a1a5-48cd-91b2-b9e338577aa5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.100289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b835b-56a9-4abd-b883-70923e0ca930 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.113256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba17b0-e280-4eaf-b42b-47f34a531dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.113919 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba17b0-e280-4eaf-b42b-47f34a531dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.114199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba17b0-e280-4eaf-b42b-47f34a531dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.114486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba17b0-e280-4eaf-b42b-47f34a531dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.115139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba17b0-e280-4eaf-b42b-47f34a531dd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:10.115441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba17b0-e280-4eaf-b42b-47f34a531dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:10.116825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba17b0-e280-4eaf-b42b-47f34a531dd7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:10.127780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 203/408] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:10.129223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c6b34-4eee-426c-9bba-2f9dd14e4aef None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.129531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c6b34-4eee-426c-9bba-2f9dd14e4aef None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.129804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c6b34-4eee-426c-9bba-2f9dd14e4aef None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.131290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 204/409] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:10.133004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c6b34-4eee-426c-9bba-2f9dd14e4aef None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.136650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:10.150272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3593445-d5b8-4023-be3c-50950e0725a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.151295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593445-d5b8-4023-be3c-50950e0725a2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.151911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593445-d5b8-4023-be3c-50950e0725a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.152186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593445-d5b8-4023-be3c-50950e0725a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.152904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3593445-d5b8-4023-be3c-50950e0725a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:10.153495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3593445-d5b8-4023-be3c-50950e0725a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:10.156260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3593445-d5b8-4023-be3c-50950e0725a2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:10.169502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 206/410] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:10.170793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1830e-2b37-4208-98ed-b08727683b18 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.171114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1830e-2b37-4208-98ed-b08727683b18 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.171428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1830e-2b37-4208-98ed-b08727683b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.195836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b4b1830e-2b37-4208-98ed-b08727683b18 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:10.197018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b4b1830e-2b37-4208-98ed-b08727683b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:10.250700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:10.273576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 207/411] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:10.274475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1830e-2b37-4208-98ed-b08727683b18 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.281239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c6b34-4eee-426c-9bba-2f9dd14e4aef None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.344767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dda15-9f2c-40ca-ad2a-82f3b4243949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.345329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dda15-9f2c-40ca-ad2a-82f3b4243949 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.345635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dda15-9f2c-40ca-ad2a-82f3b4243949 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.345908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dda15-9f2c-40ca-ad2a-82f3b4243949 None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.347855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dda15-9f2c-40ca-ad2a-82f3b4243949 None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:10.349310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dda15-9f2c-40ca-ad2a-82f3b4243949 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:10.352607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 205/412] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:10 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:10.360268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dda15-9f2c-40ca-ad2a-82f3b4243949 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.431263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1830e-2b37-4208-98ed-b08727683b18 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.508922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:10.522119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc16a91-462d-4214-90fb-340fa69a382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.522778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16a91-462d-4214-90fb-340fa69a382a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.523054 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16a91-462d-4214-90fb-340fa69a382a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.523322 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc16a91-462d-4214-90fb-340fa69a382a None admin] PATH_INFO: `/v3/groups/5582a78051fa4498a86db67469dc2d30` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.524507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc16a91-462d-4214-90fb-340fa69a382a None admin] RBAC: Authorizing `identity:get_group(group_id=5582a78051fa4498a86db67469dc2d30)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:10.526056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc16a91-462d-4214-90fb-340fa69a382a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:10.527795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 208/413] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:10 2022] GET /identity/v3/groups/5582a78051fa4498a86db67469dc2d30 => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:10.533264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc16a91-462d-4214-90fb-340fa69a382a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.570202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dda15-9f2c-40ca-ad2a-82f3b4243949 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.610087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005613d-3eb7-45ea-91f8-07a5157631fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.610698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005613d-3eb7-45ea-91f8-07a5157631fc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.610896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005613d-3eb7-45ea-91f8-07a5157631fc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.611169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005613d-3eb7-45ea-91f8-07a5157631fc None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.612314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005613d-3eb7-45ea-91f8-07a5157631fc None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:10.613782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005613d-3eb7-45ea-91f8-07a5157631fc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:10.619950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 206/414] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:10 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:10.619950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005613d-3eb7-45ea-91f8-07a5157631fc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.620998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:10.686544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc16a91-462d-4214-90fb-340fa69a382a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.730671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005613d-3eb7-45ea-91f8-07a5157631fc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.741234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e21d50-63b0-4c11-a357-d804697fbd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.742188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e21d50-63b0-4c11-a357-d804697fbd52 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.742684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e21d50-63b0-4c11-a357-d804697fbd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.743207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e21d50-63b0-4c11-a357-d804697fbd52 None admin] PATH_INFO: `/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.744569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e21d50-63b0-4c11-a357-d804697fbd52 None admin] RBAC: Authorizing `identity:get_project(project_id=f1a2335b6b0e4e3b94d114442755e8d9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:10.746274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e21d50-63b0-4c11-a357-d804697fbd52 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:10.748412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 209/415] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:10 2022] GET /identity/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:10.750057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e21d50-63b0-4c11-a357-d804697fbd52 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.767384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bda50-aec0-47a3-b863-358bc65de169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.768029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bda50-aec0-47a3-b863-358bc65de169 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.768314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bda50-aec0-47a3-b863-358bc65de169 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.768588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bda50-aec0-47a3-b863-358bc65de169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.776731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:10.784232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bda50-aec0-47a3-b863-358bc65de169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-745bda50-aec0-47a3-b863-358bc65de169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:10.789137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:10.790052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:10.790843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 207/416] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:10.791477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bda50-aec0-47a3-b863-358bc65de169 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.875009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e21d50-63b0-4c11-a357-d804697fbd52 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.899382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:10.912807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bda50-aec0-47a3-b863-358bc65de169 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:10.913334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993de8c-5232-46f5-a941-011d29e0397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.914115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993de8c-5232-46f5-a941-011d29e0397e None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.914487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993de8c-5232-46f5-a941-011d29e0397e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.915024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993de8c-5232-46f5-a941-011d29e0397e None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28/roles/72b0245082944533beab3a422c3c640a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.917387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993de8c-5232-46f5-a941-011d29e0397e None admin] RBAC: Authorizing `identity:create_grant(project_id=c74b7a27d82349698d162ee8c4036e4b, group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role_id=72b0245082944533beab3a422c3c640a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:10.918959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993de8c-5232-46f5-a941-011d29e0397e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:10.941476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 210/417] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 8 01:00:10 2022] PUT /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28/roles/72b0245082944533beab3a422c3c640a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:10.941476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993de8c-5232-46f5-a941-011d29e0397e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:10.974788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11707e-f8ea-4ef5-8e2d-12b7fd4055b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:10.975715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11707e-f8ea-4ef5-8e2d-12b7fd4055b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:10.976297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11707e-f8ea-4ef5-8e2d-12b7fd4055b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:10.976717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11707e-f8ea-4ef5-8e2d-12b7fd4055b8 None admin] PATH_INFO: `/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9/groups/5582a78051fa4498a86db67469dc2d30/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:10.984560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11707e-f8ea-4ef5-8e2d-12b7fd4055b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a2335b6b0e4e3b94d114442755e8d9, group_id=5582a78051fa4498a86db67469dc2d30, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:10.986351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11707e-f8ea-4ef5-8e2d-12b7fd4055b8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:11.016296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 208/418] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Sep 8 01:00:10 2022] PUT /identity/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9/groups/5582a78051fa4498a86db67469dc2d30/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:11.076835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993de8c-5232-46f5-a941-011d29e0397e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:11.120772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:11.121419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:11.121710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:11.121995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:11.122758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:11.123061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:11.124609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:11.135164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 211/419] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 01:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:11.142300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11707e-f8ea-4ef5-8e2d-12b7fd4055b8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:11.232511 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:11.283768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11707e-f8ea-4ef5-8e2d-12b7fd4055b8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:11.323366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e033-b392-49fb-838d-ddc44a538a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:11.323989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e033-b392-49fb-838d-ddc44a538a53 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:11.324270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e033-b392-49fb-838d-ddc44a538a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:11.324547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e033-b392-49fb-838d-ddc44a538a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:11.404851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212e033-b392-49fb-838d-ddc44a538a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:11.407180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212e033-b392-49fb-838d-ddc44a538a53 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:11.471452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:11.518615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 209/420] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:11.524213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:11.601878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:11.680443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b31300-0b74-492b-b84c-a5c20580fd48 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:11.726957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f28da4-9b05-4fa2-bef2-ae09a002e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:11.727601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f28da4-9b05-4fa2-bef2-ae09a002e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:11.727882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f28da4-9b05-4fa2-bef2-ae09a002e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:11.728154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f28da4-9b05-4fa2-bef2-ae09a002e5c1 None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:11.729282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f28da4-9b05-4fa2-bef2-ae09a002e5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:11.730744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f28da4-9b05-4fa2-bef2-ae09a002e5c1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:11.732677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 212/421] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:11 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:11.738028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e033-b392-49fb-838d-ddc44a538a53 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:11.877495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e033-b392-49fb-838d-ddc44a538a53 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:11.926141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2135fb8-3285-4509-8a8c-7fa3457fdab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:11.926800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2135fb8-3285-4509-8a8c-7fa3457fdab2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:11.927083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2135fb8-3285-4509-8a8c-7fa3457fdab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:11.927361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2135fb8-3285-4509-8a8c-7fa3457fdab2 None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:11.928556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2135fb8-3285-4509-8a8c-7fa3457fdab2 None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:11.930095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2135fb8-3285-4509-8a8c-7fa3457fdab2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:11.931750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 210/422] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:11 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:11.938269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f28da4-9b05-4fa2-bef2-ae09a002e5c1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:12.048151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f28da4-9b05-4fa2-bef2-ae09a002e5c1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:12.063285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:12.086535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed243b73-5e25-4ad5-a4e8-be03b2a0361d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:12.087205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243b73-5e25-4ad5-a4e8-be03b2a0361d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:12.087487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243b73-5e25-4ad5-a4e8-be03b2a0361d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:12.087760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243b73-5e25-4ad5-a4e8-be03b2a0361d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:12.088488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed243b73-5e25-4ad5-a4e8-be03b2a0361d None admin] RBAC: Adding query filter params (group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=e24b490d9d7146659455e535a333fad2) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:12.088798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed243b73-5e25-4ad5-a4e8-be03b2a0361d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:12.090314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed243b73-5e25-4ad5-a4e8-be03b2a0361d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:12.096855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 213/423] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:11 2022] GET /identity/v3/role_assignments?group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=193a2ccbf16642a0af3edc128493946e => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:12.153900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22e2dc-9230-494f-86b7-0f74c765158e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:12.154240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22e2dc-9230-494f-86b7-0f74c765158e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:12.154452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22e2dc-9230-494f-86b7-0f74c765158e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:12.156825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 211/424] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:12.162442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabdf95-2c96-4fd5-acc8-33abc4e8e1ee None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:12.162727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabdf95-2c96-4fd5-acc8-33abc4e8e1ee None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:12.162986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabdf95-2c96-4fd5-acc8-33abc4e8e1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:12.183043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bcabdf95-2c96-4fd5-acc8-33abc4e8e1ee None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:12.184581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bcabdf95-2c96-4fd5-acc8-33abc4e8e1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:12.299417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 214/425] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:12.427457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe366f4a-f48f-4b07-a8f3-1a386bcba48a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:12.427799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe366f4a-f48f-4b07-a8f3-1a386bcba48a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:12.428026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe366f4a-f48f-4b07-a8f3-1a386bcba48a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:12.429645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 212/426] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:12.434616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bff7-871a-42ac-b72d-3637f4f52db1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:12.434850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bff7-871a-42ac-b72d-3637f4f52db1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:12.435124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bff7-871a-42ac-b72d-3637f4f52db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:12.461663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7f58bff7-871a-42ac-b72d-3637f4f52db1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:12.462839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7f58bff7-871a-42ac-b72d-3637f4f52db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:12.556002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 215/427] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:12.605071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe366f4a-f48f-4b07-a8f3-1a386bcba48a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:12.648592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:12.744293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe366f4a-f48f-4b07-a8f3-1a386bcba48a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:12.798787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17148226-d95c-46ad-8d4b-c9da9700ba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:12.799429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17148226-d95c-46ad-8d4b-c9da9700ba00 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:12.799712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17148226-d95c-46ad-8d4b-c9da9700ba00 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:12.799988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17148226-d95c-46ad-8d4b-c9da9700ba00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:12.812970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17148226-d95c-46ad-8d4b-c9da9700ba00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-17148226-d95c-46ad-8d4b-c9da9700ba00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:12.817985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:12.818829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:12.819615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 213/428] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:00:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:12.829270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bff7-871a-42ac-b72d-3637f4f52db1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:12.868192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17148226-d95c-46ad-8d4b-c9da9700ba00 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:12.884127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:12.965815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bff7-871a-42ac-b72d-3637f4f52db1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:12.996284 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:13.009971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.010824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.011251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.011699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.012527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:13.012974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:13.014846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:13.015566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17148226-d95c-46ad-8d4b-c9da9700ba00 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:13.025283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 216/429] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:13.031295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:13.061445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90c9b4-4647-4833-bffa-28d598b62975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.062953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90c9b4-4647-4833-bffa-28d598b62975 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.063388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90c9b4-4647-4833-bffa-28d598b62975 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.063894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90c9b4-4647-4833-bffa-28d598b62975 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.079893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90c9b4-4647-4833-bffa-28d598b62975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0f90c9b4-4647-4833-bffa-28d598b62975 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:13.085439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:13.086324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 01:00:13.087120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:13.089265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 214/430] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:13.098400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90c9b4-4647-4833-bffa-28d598b62975 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:13.159506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:13.164340 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fccb-1658-4b9a-a9e7-fe9e6faf0011 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:13.211538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0605-6836-462e-8bf6-92b6f2358d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.212419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0605-6836-462e-8bf6-92b6f2358d97 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.212707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0605-6836-462e-8bf6-92b6f2358d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.212980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0605-6836-462e-8bf6-92b6f2358d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.235425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90c9b4-4647-4833-bffa-28d598b62975 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:13.279758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.280739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.281241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.281735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.282606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:13.283111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:13.284977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:13.297018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 215/431] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 01:00:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:13.301325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b0605-6836-462e-8bf6-92b6f2358d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:13.302442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:13.302857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b0605-6836-462e-8bf6-92b6f2358d97 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:13.317290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:13.424306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50221a-f7c4-498a-94c9-64fb11d3c6c0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:13.440894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:13.453636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 217/432] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:13.455535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0605-6836-462e-8bf6-92b6f2358d97 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:13.471161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd0aff-90db-4a3e-8d1d-ffebbf63c6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.472276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0aff-90db-4a3e-8d1d-ffebbf63c6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.473253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0aff-90db-4a3e-8d1d-ffebbf63c6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.473872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd0aff-90db-4a3e-8d1d-ffebbf63c6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.567143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd0aff-90db-4a3e-8d1d-ffebbf63c6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:13.568943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd0aff-90db-4a3e-8d1d-ffebbf63c6a4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:13.583228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:13.590581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0605-6836-462e-8bf6-92b6f2358d97 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:13.639822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a5fed-fbac-4792-8e80-033677ed2f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.640459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5fed-fbac-4792-8e80-033677ed2f2e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.640738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5fed-fbac-4792-8e80-033677ed2f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.641015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a5fed-fbac-4792-8e80-033677ed2f2e None admin] PATH_INFO: `/v3/projects/e24b490d9d7146659455e535a333fad2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.642177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a5fed-fbac-4792-8e80-033677ed2f2e None admin] RBAC: Authorizing `identity:get_project(project_id=e24b490d9d7146659455e535a333fad2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:13.643620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a5fed-fbac-4792-8e80-033677ed2f2e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:13.645252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 218/433] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:13 2022] GET /identity/v3/projects/e24b490d9d7146659455e535a333fad2 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:13.646403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a959e-f88a-45ed-b8dc-f01e4cad6368 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.646681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a959e-f88a-45ed-b8dc-f01e4cad6368 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.646948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a959e-f88a-45ed-b8dc-f01e4cad6368 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.649540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 219/434] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:13.651298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a959e-f88a-45ed-b8dc-f01e4cad6368 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:13.705380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 216/435] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 01:00:13.707028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8077b1-3643-4164-a1e2-e2f0a943abc5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.707320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8077b1-3643-4164-a1e2-e2f0a943abc5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.707594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8077b1-3643-4164-a1e2-e2f0a943abc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.728727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6e8077b1-3643-4164-a1e2-e2f0a943abc5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:13.730019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6e8077b1-3643-4164-a1e2-e2f0a943abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:13.730735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:13.766179 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a959e-f88a-45ed-b8dc-f01e4cad6368 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:13.800547 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05759c9e-ae52-46fb-9358-bcb3851e7507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.800750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 217/436] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:13.801196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759c9e-ae52-46fb-9358-bcb3851e7507 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.801568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759c9e-ae52-46fb-9358-bcb3851e7507 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.801718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759c9e-ae52-46fb-9358-bcb3851e7507 None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.801829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8077b1-3643-4164-a1e2-e2f0a943abc5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:13.814229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05759c9e-ae52-46fb-9358-bcb3851e7507 None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:13.815668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05759c9e-ae52-46fb-9358-bcb3851e7507 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:13.817614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 220/437] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:13 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:13.818717 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c431d-0baa-4719-9bd6-d5bdb40559ab None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.819006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c431d-0baa-4719-9bd6-d5bdb40559ab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.819256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c431d-0baa-4719-9bd6-d5bdb40559ab None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.820525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 221/438] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:13.822949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c431d-0baa-4719-9bd6-d5bdb40559ab None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:13.853105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:13.916336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8077b1-3643-4164-a1e2-e2f0a943abc5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:13.931900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c431d-0baa-4719-9bd6-d5bdb40559ab None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:13.951133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab26c3-f37c-4ac0-b010-20dbcf14cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.951764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab26c3-f37c-4ac0-b010-20dbcf14cb69 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.952045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab26c3-f37c-4ac0-b010-20dbcf14cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.952466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab26c3-f37c-4ac0-b010-20dbcf14cb69 None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.953623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab26c3-f37c-4ac0-b010-20dbcf14cb69 None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:13.955056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab26c3-f37c-4ac0-b010-20dbcf14cb69 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:13.961030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 218/439] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:13 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:13.961030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51129888-6eaa-47b0-9ecd-642c794d5d72 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.961030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51129888-6eaa-47b0-9ecd-642c794d5d72 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.961030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51129888-6eaa-47b0-9ecd-642c794d5d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.972651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:13.973245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:13.973554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:13.973827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:13.974538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] RBAC: Adding query filter params (group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role.id=72b0245082944533beab3a422c3c640a, scope.project.id=e24b490d9d7146659455e535a333fad2) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:13.974842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:13.976251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:13.976773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-51129888-6eaa-47b0-9ecd-642c794d5d72 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:13.978001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51129888-6eaa-47b0-9ecd-642c794d5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:13.978170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:13.990109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 222/440] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:13 2022] GET /identity/v3/role_assignments?group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28&scope.project.id=e24b490d9d7146659455e535a333fad2&role.id=72b0245082944533beab3a422c3c640a => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:13.991752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.085518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 219/441] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:14.085518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51129888-6eaa-47b0-9ecd-642c794d5d72 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.124551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:14.125940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77b51-823a-4b2f-b445-ac032f520b19 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.175002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b809-ee2b-412a-8439-75e94af29b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:14.175617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b809-ee2b-412a-8439-75e94af29b8a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:14.175899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b809-ee2b-412a-8439-75e94af29b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:14.176170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b809-ee2b-412a-8439-75e94af29b8a None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:14.177297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1b809-ee2b-412a-8439-75e94af29b8a None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:14.178765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1b809-ee2b-412a-8439-75e94af29b8a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:14.180514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 223/442] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:13 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:14.186004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b809-ee2b-412a-8439-75e94af29b8a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.204819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51129888-6eaa-47b0-9ecd-642c794d5d72 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.260517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39330-7852-4002-a809-28c5909d6e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:14.260798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39330-7852-4002-a809-28c5909d6e6d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:14.261173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39330-7852-4002-a809-28c5909d6e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:14.261658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39330-7852-4002-a809-28c5909d6e6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:14.270799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:14.277450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39330-7852-4002-a809-28c5909d6e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3fc39330-7852-4002-a809-28c5909d6e6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:14.284175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:14.285266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:14.287749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 220/443] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:14.290288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39330-7852-4002-a809-28c5909d6e6d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.318859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b809-ee2b-412a-8439-75e94af29b8a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.369758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:14.370655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:14.371117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:14.371595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:14.372500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] RBAC: Adding query filter params (group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role.id=193a2ccbf16642a0af3edc128493946e, scope.project.id=c74b7a27d82349698d162ee8c4036e4b) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:14.373008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:14.374820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:14.381286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 224/444] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:14 2022] GET /identity/v3/role_assignments?group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=193a2ccbf16642a0af3edc128493946e => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:14.386480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.416171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:14.425195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39330-7852-4002-a809-28c5909d6e6d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.474023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:14.474820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:14.475107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:14.475385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:14.476091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:14.476400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:14.477857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:14.489334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 221/445] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:14.495464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.524684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af070f4-6994-4902-b638-67d98e54db3e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.558172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:14.566438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7b1d-a0ca-4941-9319-056aad8d14d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:14.567366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7b1d-a0ca-4941-9319-056aad8d14d9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:14.567709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7b1d-a0ca-4941-9319-056aad8d14d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:14.568045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae7b1d-a0ca-4941-9319-056aad8d14d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:14.581343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae7b1d-a0ca-4941-9319-056aad8d14d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-71ae7b1d-a0ca-4941-9319-056aad8d14d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:14.586646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:14.587518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:14.588307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 225/446] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:00:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:14.594196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7b1d-a0ca-4941-9319-056aad8d14d9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.618060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb5cd3-e431-42c0-b348-ca2086aec751 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.661728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d961539-03b5-493d-a4f6-4b142838df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:14.662369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d961539-03b5-493d-a4f6-4b142838df31 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:14.662652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d961539-03b5-493d-a4f6-4b142838df31 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:14.663083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d961539-03b5-493d-a4f6-4b142838df31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:14.696264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:14.705082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae7b1d-a0ca-4941-9319-056aad8d14d9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.744096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:14.745518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:14.745518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:14.745518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:14.745748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:14.745885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:14.747272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:14.750363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d961539-03b5-493d-a4f6-4b142838df31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:14.751436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d961539-03b5-493d-a4f6-4b142838df31 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:14.757993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 226/447] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:14.765375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.818356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:14.859377 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 222/448] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 01:00:14.864905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d961539-03b5-493d-a4f6-4b142838df31 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:14.865988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9d76e-c3f1-4fca-8267-b2eea34c5d97 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.900783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede55dca-f190-4824-bca0-03c1242b1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:14.901421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede55dca-f190-4824-bca0-03c1242b1b22 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:14.901709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede55dca-f190-4824-bca0-03c1242b1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:14.901980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede55dca-f190-4824-bca0-03c1242b1b22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:14.934521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:14.974531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede55dca-f190-4824-bca0-03c1242b1b22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:14.975831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d961539-03b5-493d-a4f6-4b142838df31 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:14.976015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede55dca-f190-4824-bca0-03c1242b1b22 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:15.009420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d70871-f555-45d6-8321-e7d250dad336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:15.010047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d70871-f555-45d6-8321-e7d250dad336 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:15.010324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d70871-f555-45d6-8321-e7d250dad336 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:15.010590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d70871-f555-45d6-8321-e7d250dad336 None admin] PATH_INFO: `/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:15.011734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d70871-f555-45d6-8321-e7d250dad336 None admin] RBAC: Authorizing `identity:get_project(project_id=f1a2335b6b0e4e3b94d114442755e8d9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:15.013428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d70871-f555-45d6-8321-e7d250dad336 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:15.015578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 223/449] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:14 2022] GET /identity/v3/projects/f1a2335b6b0e4e3b94d114442755e8d9 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:15.021034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d70871-f555-45d6-8321-e7d250dad336 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:15.027034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:15.074394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 227/450] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:15.080453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede55dca-f190-4824-bca0-03c1242b1b22 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:15.120346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d70871-f555-45d6-8321-e7d250dad336 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:15.145868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:15.156545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3032-8bd0-40fd-b68e-52c040db60dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:15.157173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3032-8bd0-40fd-b68e-52c040db60dd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:15.157481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3032-8bd0-40fd-b68e-52c040db60dd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:15.157757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3032-8bd0-40fd-b68e-52c040db60dd None admin] PATH_INFO: `/v3/groups/5582a78051fa4498a86db67469dc2d30` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:15.158876 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f3032-8bd0-40fd-b68e-52c040db60dd None admin] RBAC: Authorizing `identity:get_group(group_id=5582a78051fa4498a86db67469dc2d30)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:15.160328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f3032-8bd0-40fd-b68e-52c040db60dd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:15.162091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 224/451] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:15 2022] GET /identity/v3/groups/5582a78051fa4498a86db67469dc2d30 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:15.167584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3032-8bd0-40fd-b68e-52c040db60dd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:15.176856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede55dca-f190-4824-bca0-03c1242b1b22 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:15.211860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be5581-261f-479d-9642-276afee5871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:15.212422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be5581-261f-479d-9642-276afee5871c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:15.212699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be5581-261f-479d-9642-276afee5871c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:15.212969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be5581-261f-479d-9642-276afee5871c None admin] PATH_INFO: `/v3/projects/c74b7a27d82349698d162ee8c4036e4b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:15.214100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be5581-261f-479d-9642-276afee5871c None admin] RBAC: Authorizing `identity:get_project(project_id=c74b7a27d82349698d162ee8c4036e4b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:15.215517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be5581-261f-479d-9642-276afee5871c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:15.217123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 228/452] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:00:15 2022] GET /identity/v3/projects/c74b7a27d82349698d162ee8c4036e4b => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:15.222979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be5581-261f-479d-9642-276afee5871c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:15.243656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:15.267629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3032-8bd0-40fd-b68e-52c040db60dd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:15.307978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:15.308584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:15.308863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:15.309135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:15.309885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] RBAC: Adding query filter params (group.id=5582a78051fa4498a86db67469dc2d30, role.id=c182619b007b495f912901d866e751e1, scope.project.id=f1a2335b6b0e4e3b94d114442755e8d9) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:15.310197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:15.312122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:15.317906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 225/453] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:15 2022] GET /identity/v3/role_assignments?group.id=5582a78051fa4498a86db67469dc2d30&scope.project.id=f1a2335b6b0e4e3b94d114442755e8d9&role.id=c182619b007b495f912901d866e751e1 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:15.331538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be5581-261f-479d-9642-276afee5871c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:15.368785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd7336-055a-4a81-bc6b-52be11764e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:15.369467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd7336-055a-4a81-bc6b-52be11764e63 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:15.369754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd7336-055a-4a81-bc6b-52be11764e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:15.370031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd7336-055a-4a81-bc6b-52be11764e63 None admin] PATH_INFO: `/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:15.371241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd7336-055a-4a81-bc6b-52be11764e63 None admin] RBAC: Authorizing `identity:get_group(group_id=2bb0423f2c5b4acaaa2ec6cceaa9ba28)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:15.372728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd7336-055a-4a81-bc6b-52be11764e63 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:15.374993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 229/454] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Sep 8 01:00:15 2022] GET /identity/v3/groups/2bb0423f2c5b4acaaa2ec6cceaa9ba28 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:15.381171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:15.443040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:15.487054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef67c-efa6-4269-ae6e-a3dc1ed1a6cd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:15.524913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ad414-a475-406c-b8a1-45aab61f4b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:15.525566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad414-a475-406c-b8a1-45aab61f4b15 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:15.525854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad414-a475-406c-b8a1-45aab61f4b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:15.526133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad414-a475-406c-b8a1-45aab61f4b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:15.526858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad414-a475-406c-b8a1-45aab61f4b15 None admin] RBAC: Adding query filter params (group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28, role.id=72b0245082944533beab3a422c3c640a, scope.project.id=c74b7a27d82349698d162ee8c4036e4b) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:15.527171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad414-a475-406c-b8a1-45aab61f4b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:15.528587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad414-a475-406c-b8a1-45aab61f4b15 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:15.534412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 226/455] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Sep 8 01:00:15 2022] GET /identity/v3/role_assignments?group.id=2bb0423f2c5b4acaaa2ec6cceaa9ba28&scope.project.id=c74b7a27d82349698d162ee8c4036e4b&role.id=72b0245082944533beab3a422c3c640a => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:18.363767 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f2fd0-ee5d-4ba1-8abe-c87e172eb0cd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:18.364284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f2fd0-ee5d-4ba1-8abe-c87e172eb0cd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:18.364591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f2fd0-ee5d-4ba1-8abe-c87e172eb0cd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:18.366427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 230/456] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:18.371848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c39b-b983-4bf2-b515-daafbea8a596 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:18.372655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c39b-b983-4bf2-b515-daafbea8a596 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:18.373128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c39b-b983-4bf2-b515-daafbea8a596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:18.397640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0599c39b-b983-4bf2-b515-daafbea8a596 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:18.399198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0599c39b-b983-4bf2-b515-daafbea8a596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:18.491746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 227/457] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:18.597446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f48a6d-0da3-4f11-ace0-39f3cb05981a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:18.598078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f48a6d-0da3-4f11-ace0-39f3cb05981a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:18.598567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f48a6d-0da3-4f11-ace0-39f3cb05981a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:18.600303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 231/458] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:18.606043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b658-0ef8-4ae2-a338-3d84d07f19a7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:18.606549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b658-0ef8-4ae2-a338-3d84d07f19a7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:18.607020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3b658-0ef8-4ae2-a338-3d84d07f19a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:18.633649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a4b3b658-0ef8-4ae2-a338-3d84d07f19a7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:18.634830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a4b3b658-0ef8-4ae2-a338-3d84d07f19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:18.710413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:18.740796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 228/459] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 01:00:18.804082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da195738-5df6-4cb6-b03d-dc80ab829328 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:18.804396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da195738-5df6-4cb6-b03d-dc80ab829328 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:18.804638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da195738-5df6-4cb6-b03d-dc80ab829328 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:18.806231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 232/460] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:18.812037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ce61b-554c-4691-b503-4d491f70afe2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:18.812349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ce61b-554c-4691-b503-4d491f70afe2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:18.812598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ce61b-554c-4691-b503-4d491f70afe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:18.835695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e76ce61b-554c-4691-b503-4d491f70afe2 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:18.835881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da195738-5df6-4cb6-b03d-dc80ab829328 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:18.836916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e76ce61b-554c-4691-b503-4d491f70afe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:18.919542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 229/461] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:18.978041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5636597-902a-4b9a-905c-445bb47a8626 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:18.978723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5636597-902a-4b9a-905c-445bb47a8626 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:18.979004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5636597-902a-4b9a-905c-445bb47a8626 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:18.980999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 230/462] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:00:18.986301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b894-4846-43a6-8dc3-d7f3ee767ae5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:18.986581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b894-4846-43a6-8dc3-d7f3ee767ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:18.986854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b894-4846-43a6-8dc3-d7f3ee767ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:18.989849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:19.009761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-de16b894-4846-43a6-8dc3-d7f3ee767ae5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:19.010944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-de16b894-4846-43a6-8dc3-d7f3ee767ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:19.015542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da195738-5df6-4cb6-b03d-dc80ab829328 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.071260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.072128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.072554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.073000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.084691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.086500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:19.103487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:19.104560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:19.105600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:19.105600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:19.105600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:19.105804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 231/463] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:19.105804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b894-4846-43a6-8dc3-d7f3ee767ae5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.114933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 233/464] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:19.120454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.155881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:19.243767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b894-4846-43a6-8dc3-d7f3ee767ae5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.276933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6ee3e-354d-4d2c-a351-9bc8c0662b19 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.299024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.299667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.300110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.300560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.314995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.315922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.316400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.316883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.317809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:19.318312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.319946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.323375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.324834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.336482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:19.341026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 234/465] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:19.346664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:19.352361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:19.353323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:19.354186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:19.354186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:19.354186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:19.354186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 232/466] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:19.363709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.464808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c34b5-287a-4a34-8bfc-25e31e7cce1b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.470653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:19.478446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ace84-02da-4a9c-80bd-8c1ec86214e2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.501720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f529f-069d-4621-b78b-28cae6d7d9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.502533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f529f-069d-4621-b78b-28cae6d7d9af None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.502985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f529f-069d-4621-b78b-28cae6d7d9af None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.503248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f529f-069d-4621-b78b-28cae6d7d9af None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.503910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f529f-069d-4621-b78b-28cae6d7d9af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.505372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f529f-069d-4621-b78b-28cae6d7d9af None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.520527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.521439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.521930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.522361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.523069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:19.523347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.524975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.529121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 235/467] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:00:19 2022] POST /identity/v3/users => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:19.538547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 233/468] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:19.539322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.539425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f529f-069d-4621-b78b-28cae6d7d9af None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.611025 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:19.656309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35fb58-774a-4c05-95e8-110fe6e521c7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.667690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f529f-069d-4621-b78b-28cae6d7d9af None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.698575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.699620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.699620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.699875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.711907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.712644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.713389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.714578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.714862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.715136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.727570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.729024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:19.730839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:19.731690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:19.732512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:19.732512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:19.732512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:19.732512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 234/469] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:19.733105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.744596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:19.750722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:19.751641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:19.752516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:19.752516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:19.752516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:19.752516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 236/470] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:19.752737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.855484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697e8b-ffdb-4fa1-bbbe-b0bb828dfa3b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.863521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dc9d2-3177-4712-875e-0e12bce47b59 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:19.872472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:19.893381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff203f4-0051-4a75-89a0-d813d96931d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.894030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff203f4-0051-4a75-89a0-d813d96931d1 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.894311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff203f4-0051-4a75-89a0-d813d96931d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.894585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff203f4-0051-4a75-89a0-d813d96931d1 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.895236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff203f4-0051-4a75-89a0-d813d96931d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.896690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff203f4-0051-4a75-89a0-d813d96931d1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.900599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:19.901366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.901830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.902244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.903017 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:19.903458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:19.904999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:19.922560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 237/471] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:19.922560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:19.929615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 235/472] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:00:19 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:19.931490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006bb6-b628-440c-9df5-7e25707d751d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:19.932057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006bb6-b628-440c-9df5-7e25707d751d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:19.932519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006bb6-b628-440c-9df5-7e25707d751d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:19.934285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 236/473] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:19.935439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a006bb6-b628-440c-9df5-7e25707d751d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:20.019548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:20.059575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c492d3-3718-423c-af1b-b16839d01111 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:20.071663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a006bb6-b628-440c-9df5-7e25707d751d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:20.110267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aca4d-5f9d-4793-ba37-e89ca1aff14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:20.110784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aca4d-5f9d-4793-ba37-e89ca1aff14e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:20.111068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aca4d-5f9d-4793-ba37-e89ca1aff14e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:20.111345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aca4d-5f9d-4793-ba37-e89ca1aff14e None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:20.112057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aca4d-5f9d-4793-ba37-e89ca1aff14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:20.112369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aca4d-5f9d-4793-ba37-e89ca1aff14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:20.113771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aca4d-5f9d-4793-ba37-e89ca1aff14e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:20.115745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda229b-1911-4b32-bbea-9ac631758b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:20.117228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda229b-1911-4b32-bbea-9ac631758b32 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:20.117228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda229b-1911-4b32-bbea-9ac631758b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:20.117228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda229b-1911-4b32-bbea-9ac631758b32 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:20.117596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda229b-1911-4b32-bbea-9ac631758b32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:20.119388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda229b-1911-4b32-bbea-9ac631758b32 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:20.126908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 238/474] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:20.128341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceec60-5e5c-4ce1-b53b-232824d4376d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:20.128629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceec60-5e5c-4ce1-b53b-232824d4376d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:20.128902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceec60-5e5c-4ce1-b53b-232824d4376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:20.145530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 237/475] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:00:19 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:20.146418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda229b-1911-4b32-bbea-9ac631758b32 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:20.150297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-afceec60-5e5c-4ce1-b53b-232824d4376d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:20.151531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-afceec60-5e5c-4ce1-b53b-232824d4376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:20.182379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:20.244874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 239/476] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:20.267016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda229b-1911-4b32-bbea-9ac631758b32 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:20.287060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:20.309090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90c0b0-dc54-474f-aa08-7366d8b0477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:20.309760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90c0b0-dc54-474f-aa08-7366d8b0477a None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:20.310039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90c0b0-dc54-474f-aa08-7366d8b0477a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:20.310315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90c0b0-dc54-474f-aa08-7366d8b0477a None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:20.310975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90c0b0-dc54-474f-aa08-7366d8b0477a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:20.312499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90c0b0-dc54-474f-aa08-7366d8b0477a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:20.341589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 238/477] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:00:20 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:20.542441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceec60-5e5c-4ce1-b53b-232824d4376d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:20.661789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceec60-5e5c-4ce1-b53b-232824d4376d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:20.698939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:20.699550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:20.699830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:20.700111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:20.700786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:20.702417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:20.714048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.sql.core [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 01:00:20.714048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 01:00:20.714048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [parameters: {'id': 'ffe132093ed541ecb69a4f00bbb3b170', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 01:00:20.714048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81676) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Sep 08 01:00:20.731234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return ref.to_dict() Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 01:00:20.732175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application yield resource Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise self.value Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application session.commit() Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 01:00:20.733080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.flush() Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application compat.raise_( Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 01:00:20.734053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 01:00:20.734914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 01:00:20.735703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [parameters: {'id': 'ffe132093ed541ecb69a4f00bbb3b170', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:20.736564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 01:00:20.738483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:20.740552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 240/478] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 8 01:00:20 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:20.740694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90c0b0-dc54-474f-aa08-7366d8b0477a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:20.889122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90c0b0-dc54-474f-aa08-7366d8b0477a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:20.925415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51097b-3019-4c7c-81db-5bb868644565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:20.926055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51097b-3019-4c7c-81db-5bb868644565 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:20.926332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51097b-3019-4c7c-81db-5bb868644565 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:20.926602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51097b-3019-4c7c-81db-5bb868644565 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:20.945113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51097b-3019-4c7c-81db-5bb868644565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1c51097b-3019-4c7c-81db-5bb868644565 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:20.950613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:20.952690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:20.954652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 239/479] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:00:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:20.958552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:21.006573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:21.116264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344e0a-d8c5-483f-83b1-2c7d58dea7b2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:21.162939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee60f1b-cb7f-40c2-b372-9af35964bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:21.163469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee60f1b-cb7f-40c2-b372-9af35964bc20 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:21.163748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee60f1b-cb7f-40c2-b372-9af35964bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:21.164016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee60f1b-cb7f-40c2-b372-9af35964bc20 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:21.164689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee60f1b-cb7f-40c2-b372-9af35964bc20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:21.164987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee60f1b-cb7f-40c2-b372-9af35964bc20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:21.166364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee60f1b-cb7f-40c2-b372-9af35964bc20 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:21.180071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 241/480] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:22.183511 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecf319-9bae-4a98-aa61-b127407a47d7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:22.184397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecf319-9bae-4a98-aa61-b127407a47d7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:22.184833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecf319-9bae-4a98-aa61-b127407a47d7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:22.187098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 240/481] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:22.192762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c093-fefa-4800-b9f3-02ae8d914fba None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:22.193608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c093-fefa-4800-b9f3-02ae8d914fba None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:22.194050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62c093-fefa-4800-b9f3-02ae8d914fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:22.220493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5b62c093-fefa-4800-b9f3-02ae8d914fba None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:22.221948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5b62c093-fefa-4800-b9f3-02ae8d914fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:22.312021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 242/482] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 01:00:22.586773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d7f5-e6dd-4123-8591-0badff9c1f29 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:22.587221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d7f5-e6dd-4123-8591-0badff9c1f29 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:22.587590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d7f5-e6dd-4123-8591-0badff9c1f29 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:22.589348 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 241/483] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:22.594890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f023ed-5c30-460d-ab8e-a4f17b4d58f0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:22.595298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f023ed-5c30-460d-ab8e-a4f17b4d58f0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:22.595676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f023ed-5c30-460d-ab8e-a4f17b4d58f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:22.619556 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-70f023ed-5c30-460d-ab8e-a4f17b4d58f0 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:22.620736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-70f023ed-5c30-460d-ab8e-a4f17b4d58f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:22.634020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:22.691903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d7f5-e6dd-4123-8591-0badff9c1f29 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:22.709423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 243/484] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:22.750114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:22.844350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d7f5-e6dd-4123-8591-0badff9c1f29 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:22.897109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f34492-ab1f-4600-8df4-d9a2be3800eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:22.897780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f34492-ab1f-4600-8df4-d9a2be3800eb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:22.898064 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f34492-ab1f-4600-8df4-d9a2be3800eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:22.898339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f34492-ab1f-4600-8df4-d9a2be3800eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:22.915502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f34492-ab1f-4600-8df4-d9a2be3800eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b3f34492-ab1f-4600-8df4-d9a2be3800eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:22.920465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:22.921500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:22.922313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:22.925024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 242/485] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:22.930617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f023ed-5c30-460d-ab8e-a4f17b4d58f0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.050892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f34492-ab1f-4600-8df4-d9a2be3800eb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.073527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f023ed-5c30-460d-ab8e-a4f17b4d58f0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.113230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc722b3-b590-4e43-b783-e666918c06db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:23.114282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc722b3-b590-4e43-b783-e666918c06db None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.114815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc722b3-b590-4e43-b783-e666918c06db None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.115319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc722b3-b590-4e43-b783-e666918c06db None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.116150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc722b3-b590-4e43-b783-e666918c06db None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:23.116619 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc722b3-b590-4e43-b783-e666918c06db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:23.118233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc722b3-b590-4e43-b783-e666918c06db None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:23.126554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 244/486] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:23.127587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313aa9f-65ab-45b9-80d9-932528918a57 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.127873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313aa9f-65ab-45b9-80d9-932528918a57 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.128130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313aa9f-65ab-45b9-80d9-932528918a57 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.133429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 245/487] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:23.133429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ad0-efb3-4ecb-8a75-9da2d93f1e95 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.133429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ad0-efb3-4ecb-8a75-9da2d93f1e95 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.133429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ad0-efb3-4ecb-8a75-9da2d93f1e95 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.133429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 246/488] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:23.133429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994ad0-efb3-4ecb-8a75-9da2d93f1e95 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.143039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:23.173326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:23.181260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f34492-ab1f-4600-8df4-d9a2be3800eb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.218166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f84ea-8542-46ec-a9b3-5fca7aa37c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:23.218788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f84ea-8542-46ec-a9b3-5fca7aa37c3c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.219046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f84ea-8542-46ec-a9b3-5fca7aa37c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.219322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f84ea-8542-46ec-a9b3-5fca7aa37c3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.229759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f84ea-8542-46ec-a9b3-5fca7aa37c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4e7f84ea-8542-46ec-a9b3-5fca7aa37c3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:23.235069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:23.235978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 243/489] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:23.241700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae903-c47d-451f-ae3f-d8d528cd7d6a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.242402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae903-c47d-451f-ae3f-d8d528cd7d6a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.242402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae903-c47d-451f-ae3f-d8d528cd7d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.247544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994ad0-efb3-4ecb-8a75-9da2d93f1e95 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.256747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-966ae903-c47d-451f-ae3f-d8d528cd7d6a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:23.257955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-966ae903-c47d-451f-ae3f-d8d528cd7d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:23.282204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65d619-d395-4bfe-8db8-05cfdf606958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:23.282823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d619-d395-4bfe-8db8-05cfdf606958 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.283098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d619-d395-4bfe-8db8-05cfdf606958 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.283369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d619-d395-4bfe-8db8-05cfdf606958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.293681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65d619-d395-4bfe-8db8-05cfdf606958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:23.295111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65d619-d395-4bfe-8db8-05cfdf606958 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9d65d619-d395-4bfe-8db8-05cfdf606958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:23.309532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:23.310437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:23.311403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:23.311403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:23.311403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:23.311403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 247/490] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:23.312189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b6be-c7f9-4197-a570-bb6a620082f7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.312469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b6be-c7f9-4197-a570-bb6a620082f7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.312733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b6be-c7f9-4197-a570-bb6a620082f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.330662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 244/491] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:23.331501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ae903-c47d-451f-ae3f-d8d528cd7d6a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.347833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2100b6be-c7f9-4197-a570-bb6a620082f7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:23.349793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2100b6be-c7f9-4197-a570-bb6a620082f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:23.426577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:23.429303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:23.448807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 248/492] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:23.450019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100b6be-c7f9-4197-a570-bb6a620082f7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.451873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ae903-c47d-451f-ae3f-d8d528cd7d6a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.525966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:23.526584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.526864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.527131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.527796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:23.528135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:23.529591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:23.546792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 245/493] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:23.551774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.618949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100b6be-c7f9-4197-a570-bb6a620082f7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.662952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:23.663827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.664108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.664380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.665284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:23.666028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:23.667688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:23.668620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965217e3-706e-4078-9f68-926626654bb4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.681578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 249/494] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:23.682608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.707779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:23.708764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.709107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.709480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.722184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:23.723670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:23.731990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:23.743547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:23.744449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:23.746305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:23.746305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:23.746305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:23.746643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:23.746769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 246/495] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:23.746769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.812053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e12dee-8ec9-4633-a6c9-9bf907b1939d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.848813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185296a-cd6f-4660-ab8c-8d1c3266bcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:23.849467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185296a-cd6f-4660-ab8c-8d1c3266bcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.849752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185296a-cd6f-4660-ab8c-8d1c3266bcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.850022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185296a-cd6f-4660-ab8c-8d1c3266bcc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.861312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185296a-cd6f-4660-ab8c-8d1c3266bcc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:23.863421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858ab47-fe83-48eb-86fa-1a40d8be451a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e185296a-cd6f-4660-ab8c-8d1c3266bcc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:23.866659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:23.867546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 250/496] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:23.870355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185296a-cd6f-4660-ab8c-8d1c3266bcc8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.902774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:23.903396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:23.903677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:23.904146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:23.911752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:23.913267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:23.927192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:23.928096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:23.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 247/497] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:23.929551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:23.979683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185296a-cd6f-4660-ab8c-8d1c3266bcc8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:23.989257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:23.999753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.016889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.017528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.017814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.018087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.018792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:24.019098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.020494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.037299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 251/498] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:24.037299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.048999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed123d-7666-4de7-898a-8899cbb7c422 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.086729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bef18d-a1e7-4394-b708-8109e31f4420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.087356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bef18d-a1e7-4394-b708-8109e31f4420 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.087634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bef18d-a1e7-4394-b708-8109e31f4420 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.087905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bef18d-a1e7-4394-b708-8109e31f4420 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.098941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bef18d-a1e7-4394-b708-8109e31f4420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-52bef18d-a1e7-4394-b708-8109e31f4420 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:24.104144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:24.105035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:24.105873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 248/499] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:24.106538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bef18d-a1e7-4394-b708-8109e31f4420 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.149684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36585-9012-4d36-823d-188f95166083 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.183178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.183782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.184064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.184335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.184998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:24.185310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.187250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.197440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 252/500] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:24.197440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.220309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bef18d-a1e7-4394-b708-8109e31f4420 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.231174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.241360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.260786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.261412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.261890 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.262170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.263503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:24.263799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.265338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.306548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 249/501] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:24.307410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.314726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f37209-e5c3-491a-b9e2-92012aff83d5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.349855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.350877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.351163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.351444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.360097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.361570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:24.374009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:24.374892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:24.375758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 253/502] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:24.376318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.411816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff4c5-2c0f-481f-b137-330631b86605 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.445798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.446398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.446672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.446940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.447598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:24.447899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.449265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.457734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 250/503] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:24.458522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.468289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.478482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bcf32-8595-41ea-a1ac-27e9f60bfbc5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.499169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.512100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab0e50-6a74-435e-89aa-cb72710804e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.512808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0e50-6a74-435e-89aa-cb72710804e7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.513418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0e50-6a74-435e-89aa-cb72710804e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.513789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0e50-6a74-435e-89aa-cb72710804e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.524883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab0e50-6a74-435e-89aa-cb72710804e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.526357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab0e50-6a74-435e-89aa-cb72710804e7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f4ab0e50-6a74-435e-89aa-cb72710804e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:24.540035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:24.541092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:24.542112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:24.542112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:24.542112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:24.545546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 254/504] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:24.547418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82a7d-41f5-4eaf-a8f6-8a0978102cee None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.547703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82a7d-41f5-4eaf-a8f6-8a0978102cee None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.547978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82a7d-41f5-4eaf-a8f6-8a0978102cee None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.549248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 255/505] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:24.549988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab82a7d-41f5-4eaf-a8f6-8a0978102cee None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.564459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bbd84-5459-4f26-9cdc-29c0fdf1acc5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.598310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7167c-a962-49a8-bc7e-78af6095b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.598907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7167c-a962-49a8-bc7e-78af6095b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.599187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7167c-a962-49a8-bc7e-78af6095b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.599458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7167c-a962-49a8-bc7e-78af6095b0d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.651020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab82a7d-41f5-4eaf-a8f6-8a0978102cee None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.666220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7167c-a962-49a8-bc7e-78af6095b0d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.667698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7167c-a962-49a8-bc7e-78af6095b0d2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.684490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.685088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.685364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.685685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.686490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:24.686791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.688197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.705899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.721199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.730040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 256/506] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:24.730746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.767766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 251/507] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:24.768528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7167c-a962-49a8-bc7e-78af6095b0d2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.832192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c58a4-0a0c-4dee-8b54-fc02674cf916 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.865985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa1e12-e1e6-4098-9a0b-8c61a80f2bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.866602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1e12-e1e6-4098-9a0b-8c61a80f2bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.866880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1e12-e1e6-4098-9a0b-8c61a80f2bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.867150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1e12-e1e6-4098-9a0b-8c61a80f2bb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.867237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7167c-a962-49a8-bc7e-78af6095b0d2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:24.877052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa1e12-e1e6-4098-9a0b-8c61a80f2bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.878527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa1e12-e1e6-4098-9a0b-8c61a80f2bb2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-fdfa1e12-e1e6-4098-9a0b-8c61a80f2bb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:24.893015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:24.893955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:24.894805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:24.894805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:24.894805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:24.894805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 257/508] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:24.895286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36e3b-7ef3-4e94-af32-e9bd209157c3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.895579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36e3b-7ef3-4e94-af32-e9bd209157c3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.895854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b36e3b-7ef3-4e94-af32-e9bd209157c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.903288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:24.903883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:24.904162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:24.904432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:24.905593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:24.905897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:24.907260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:24.913624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b6b36e3b-7ef3-4e94-af32-e9bd209157c3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:24.914806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b6b36e3b-7ef3-4e94-af32-e9bd209157c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:24.915432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.921180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 252/509] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:24.924014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:24.965937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:24.986459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 258/510] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:24.987324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36e3b-7ef3-4e94-af32-e9bd209157c3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.028135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75077520-1397-457a-9b00-c08fc87bd847 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.064424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132ede1-5de9-4c47-a302-8f107acc10c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.065327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ede1-5de9-4c47-a302-8f107acc10c5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.065897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ede1-5de9-4c47-a302-8f107acc10c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.066399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ede1-5de9-4c47-a302-8f107acc10c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.089854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b36e3b-7ef3-4e94-af32-e9bd209157c3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.128032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.128673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.128955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.129229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.140654 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.142147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.144452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:25.148846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132ede1-5de9-4c47-a302-8f107acc10c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.150487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132ede1-5de9-4c47-a302-8f107acc10c5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:25.158595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:25.159465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:25.160280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:25.160280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:25.160280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:25.160280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 259/511] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:25.160494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.196863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:25.262961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 253/512] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:25.264694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132ede1-5de9-4c47-a302-8f107acc10c5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.266309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656e583-40af-4dee-865e-26e8e7b09e88 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.299727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.300261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.300538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.300810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.301476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:25.301777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.303158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.315783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 260/513] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:25.316547 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.362112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:25.365964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132ede1-5de9-4c47-a302-8f107acc10c5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.402837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.403451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.403725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.403990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.410170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:25.411312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.412836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.417884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b462f88-0d4a-4a52-b5b0-82564679c6f4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:25.424239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:25.425132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 254/514] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:25.426063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.454259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.454865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.455154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.455428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.456062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:25.456363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.457768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.469195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 261/515] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:25.469844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.533264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4f59-71cd-47f3-90c9-3db12289e45e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.565236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.565824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.566101 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.566371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.570544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c37a-b564-42d1-b9d8-c082035e670d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.576514 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.578492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:25.592107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:25.593844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:25.594664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:25.594664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:25.594664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:25.594664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 255/516] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:25.594664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.605799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.606429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.606710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.606977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.607609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:25.617928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.619355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:25.633649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:25.634649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:25.635639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:25.635639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:25.635639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:25.635639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 262/517] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:25.636062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.648145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:25.697207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4287bb-2d31-4d80-9c7f-a6a11841b2f6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.729727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.730468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.730774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.731050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.737841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e43ba-5f6d-4e6f-892a-a5df3c24fc29 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.738866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.740336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:25.751868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:25.752769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:25.753662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 256/518] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:25.754238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.775883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.776562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.776842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.777111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.777854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:25.778161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.779567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.796292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 263/519] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:25.797070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.822839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:25.853700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ac9c2-71f6-4eb3-8402-810844eac0cc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.858146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:25.887536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.888409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.888688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.888964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.895770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.896081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1038c0-a63e-4528-b10d-d216f2225057 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:25.897201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:25.909658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:25.910530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:25.911384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 257/520] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:25.911835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:25.942574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:25.943183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:25.943469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:25.943741 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:25.944379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:25.944684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:25.946073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:25.957341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 264/521] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:25.958158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.018304 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8420b06-5424-46d3-95d2-8e49b2c01377 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.045870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:26.052236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.052842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.053124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.053414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.054066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:26.054378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.055742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.059101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30c273-e6bd-4814-a313-875838528f29 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.067875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 258/522] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:26.068678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.083314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:26.094454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.095056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.095336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.095604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.096315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:26.096615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.098077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.115306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 265/523] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Sep 8 01:00:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:26.116162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.167379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da631cb-7a1e-49a2-90f9-3ef1d2f02d96 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.200961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65977d8-6005-45e9-a036-f95f394fac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.201600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65977d8-6005-45e9-a036-f95f394fac3a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.202411 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65977d8-6005-45e9-a036-f95f394fac3a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.202688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65977d8-6005-45e9-a036-f95f394fac3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.212364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93774b-b5f0-4a4e-8080-126f4e49ec80 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.245329 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.245945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.246215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.246480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.247152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:26.247448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.248879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.257974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:26.267067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 266/524] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:26.267856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.269711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65977d8-6005-45e9-a036-f95f394fac3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.272372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65977d8-6005-45e9-a036-f95f394fac3a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.310189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:26.367815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7409-9c12-45fe-b494-218e88d27b30 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.369814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 259/525] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:26.370656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65977d8-6005-45e9-a036-f95f394fac3a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.402018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489b413-c5e4-42ac-91e5-a9752d1eef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.402619 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b413-c5e4-42ac-91e5-a9752d1eef6e None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.402895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b413-c5e4-42ac-91e5-a9752d1eef6e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.403165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489b413-c5e4-42ac-91e5-a9752d1eef6e None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.403794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489b413-c5e4-42ac-91e5-a9752d1eef6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.405768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489b413-c5e4-42ac-91e5-a9752d1eef6e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.425503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 267/526] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:00:26 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:26.426300 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489b413-c5e4-42ac-91e5-a9752d1eef6e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.481267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:26.495620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65977d8-6005-45e9-a036-f95f394fac3a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.544413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:26.547668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.548324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.548600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.548697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489b413-c5e4-42ac-91e5-a9752d1eef6e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.548863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.557564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.559028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:26.574175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:26.575079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:26.575969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:26.575969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:26.575969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:26.575969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:26.575969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:26.575969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:26.575969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:26.575969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:26.578387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 260/527] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:26.579438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.595157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694f248-0b35-4f60-a577-56a2fcb20595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.595795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f248-0b35-4f60-a577-56a2fcb20595 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.596449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f248-0b35-4f60-a577-56a2fcb20595 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.596449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f248-0b35-4f60-a577-56a2fcb20595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.678072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694f248-0b35-4f60-a577-56a2fcb20595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.679548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694f248-0b35-4f60-a577-56a2fcb20595 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.695440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b0ee-c819-4972-aa50-637d9a7802bb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.732026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.732684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.732968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.733358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.734128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=1b9f7c644bde4c94a8cfe5ec13e782c3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:26.734492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.735939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.742020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 261/528] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/role_assignments?user.id=1b9f7c644bde4c94a8cfe5ec13e782c3&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:26.743269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.767540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:26.786483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:26.789639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 268/529] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:26.790685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694f248-0b35-4f60-a577-56a2fcb20595 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.865802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9477b-0129-4b7a-8487-8b70677d1b0c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.903622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.904270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.904586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.904833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.906426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694f248-0b35-4f60-a577-56a2fcb20595 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:26.916990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.918522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:26.934545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:26.935670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:26.936869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:26.936869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:26.936869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:26.940277 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 262/530] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:26.941023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:26.953202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:26.953973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:26.954369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:26.954818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:26.955617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:26.956022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:26.957708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:26.970708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 269/531] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:26.971934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:27.010051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:27.038436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:27.047466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffe75-4ea1-4d6b-bd68-3c2269be7dd9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:27.082631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:27.083254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:27.083537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:27.083815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:27.087276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da1fdf-aa72-4c3d-b2a7-3a8da5dd082f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:27.096115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:27.097638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:27.112706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:27.113715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:27.114553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:27.114553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:27.114553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:27.114553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 263/532] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:27.115213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:27.129026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:27.129960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:27.130444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:27.130993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:27.131913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:27.132446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:27.134065 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:27.147929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 270/533] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:27.149028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:27.265243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35092640-c44c-4a9f-9b11-568aeb3a383d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:27.304470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:27.307974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28921-951d-4ec2-8692-4e790d8edf75 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:27.334134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:27.336190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:27.336952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:27.337303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:27.337621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:27.338365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=274ba5fef7d24d97ac97c33a68bb6aec) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:27.338680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:27.340699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:27.352084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 264/534] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:27 2022] GET /identity/v3/role_assignments?user.id=274ba5fef7d24d97ac97c33a68bb6aec&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:27.353362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:27.375773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:27.377113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:27.377657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:27.378127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:27.378985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:27.379509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:27.381093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:27.410845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 271/535] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:27.414295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:27.592210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783efc0-f800-4ab6-b547-f1998a08a9f0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:27.638966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbb3b7-5495-40b5-9736-4242241258cc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:27.663860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:27.664497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:27.664776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:27.665046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:27.682101 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:27.683587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:27.705237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:27.706167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:27.707013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 265/536] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:27.716750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:27.717852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:27.718514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:27.718796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:27.719068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:27.731133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:27.732613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:27.762100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:27.764948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:27.766953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 272/537] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:27.772347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:27.774998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:27.837603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b92924-6ff9-428d-9ebe-d7af4d8cd4b3 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:27.876720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:27.877659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:27.878121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:27.878571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:27.879465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:27.879689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:27.880944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:27.882588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:27.902982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 266/538] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:27.909747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:27.989663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939180-f0d3-4b5f-ae11-3087a2df14aa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:28.022477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f54a-90ac-4842-bdd2-5b96a5398a97 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:28.024433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:28.025345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:28.026264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:28.027225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:28.027225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:28.028474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:28.028789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:28.030842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:28.044466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 273/539] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:28.050361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:28.075285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17a97e-f7ab-468a-8dd7-c4eb6fbe2ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:28.076136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17a97e-f7ab-468a-8dd7-c4eb6fbe2ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:28.076561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17a97e-f7ab-468a-8dd7-c4eb6fbe2ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:28.077589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17a97e-f7ab-468a-8dd7-c4eb6fbe2ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:28.078488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17a97e-f7ab-468a-8dd7-c4eb6fbe2ac3 None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=21d637726e3142e6ba90fa201c764b0b) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:28.079939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17a97e-f7ab-468a-8dd7-c4eb6fbe2ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:28.083647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17a97e-f7ab-468a-8dd7-c4eb6fbe2ac3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:28.096189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 267/540] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:27 2022] GET /identity/v3/role_assignments?user.id=21d637726e3142e6ba90fa201c764b0b&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:28.173810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:28.178127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7384c14-bf99-471b-9b89-e8eeaa390996 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:28.227257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a524a3e-b39b-405b-81fd-1e781ac9664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:28.228128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524a3e-b39b-405b-81fd-1e781ac9664e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:28.228552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524a3e-b39b-405b-81fd-1e781ac9664e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:28.228967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a524a3e-b39b-405b-81fd-1e781ac9664e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:28.229889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a524a3e-b39b-405b-81fd-1e781ac9664e None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=5a6ff1b9371a411bae7b3e45f78e05e6) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:28.230371 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a524a3e-b39b-405b-81fd-1e781ac9664e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:28.232057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a524a3e-b39b-405b-81fd-1e781ac9664e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:28.239070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 274/541] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:28 2022] GET /identity/v3/role_assignments?user.id=5a6ff1b9371a411bae7b3e45f78e05e6&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:28.909338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb0f8d-d2e9-45f5-95f3-30e296ed0b4e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:28.910396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb0f8d-d2e9-45f5-95f3-30e296ed0b4e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:28.910901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb0f8d-d2e9-45f5-95f3-30e296ed0b4e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:28.912757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 268/542] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:28.917804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754314f2-d9ff-4ed3-a1c1-5bb3d6c09ca6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:28.918601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754314f2-d9ff-4ed3-a1c1-5bb3d6c09ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:28.919098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754314f2-d9ff-4ed3-a1c1-5bb3d6c09ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:28.942418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-754314f2-d9ff-4ed3-a1c1-5bb3d6c09ca6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:28.944081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-754314f2-d9ff-4ed3-a1c1-5bb3d6c09ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:29.028671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 275/543] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:29.322841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a2d27-8c76-435c-90b4-c4782ced961f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:29.323356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a2d27-8c76-435c-90b4-c4782ced961f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:29.323777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a2d27-8c76-435c-90b4-c4782ced961f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:29.325592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 269/544] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:29.331112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf26a0-6542-4af2-a5d0-32366ae7901c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:29.331404 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf26a0-6542-4af2-a5d0-32366ae7901c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:29.331681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf26a0-6542-4af2-a5d0-32366ae7901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:29.357117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-95cf26a0-6542-4af2-a5d0-32366ae7901c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:29.358924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-95cf26a0-6542-4af2-a5d0-32366ae7901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:29.446073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 276/545] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:29.452852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a2d27-8c76-435c-90b4-c4782ced961f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:29.581268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a2d27-8c76-435c-90b4-c4782ced961f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:29.616780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c42fe-78cf-4984-bae8-d91b0c58c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:29.617431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c42fe-78cf-4984-bae8-d91b0c58c45e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:29.617737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c42fe-78cf-4984-bae8-d91b0c58c45e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:29.618009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c42fe-78cf-4984-bae8-d91b0c58c45e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:29.629500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c42fe-78cf-4984-bae8-d91b0c58c45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-966c42fe-78cf-4984-bae8-d91b0c58c45e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:29.634347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:29.635197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:29.636165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 270/546] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:29.642046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf26a0-6542-4af2-a5d0-32366ae7901c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:29.694568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:29.738908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c42fe-78cf-4984-bae8-d91b0c58c45e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:29.771266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:29.839876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf26a0-6542-4af2-a5d0-32366ae7901c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:29.864119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c42fe-78cf-4984-bae8-d91b0c58c45e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:29.901279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c97ed-9c25-4543-95f2-fc7f1c041137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:29.901945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c97ed-9c25-4543-95f2-fc7f1c041137 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:29.902230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c97ed-9c25-4543-95f2-fc7f1c041137 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:29.902488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c97ed-9c25-4543-95f2-fc7f1c041137 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:29.913149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c97ed-9c25-4543-95f2-fc7f1c041137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4e7c97ed-9c25-4543-95f2-fc7f1c041137 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:29.918078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:29.918932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:29.919734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:29.920333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:29.920333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:29.920333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:29.920333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:29.921391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:29.921391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:29.922102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:29.924932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 271/547] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:29.926186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c97ed-9c25-4543-95f2-fc7f1c041137 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:29.940000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 277/548] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:29.945275 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.017821 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:30.030611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c97ed-9c25-4543-95f2-fc7f1c041137 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.065587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.066295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.066648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.066984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.067723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:30.068097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:30.069582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:30.082963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 272/549] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:30.084163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.116265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:30.151841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054d736-6f3d-49e5-9186-b79e16fb0176 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.192562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6495-05dd-4557-8c1f-5486a0a22fad None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.219443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e1a58-1162-45f4-91ef-afa014c152cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.220102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1a58-1162-45f4-91ef-afa014c152cb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.220381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1a58-1162-45f4-91ef-afa014c152cb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.220649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1a58-1162-45f4-91ef-afa014c152cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.228358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2596-d114-4754-b4e8-9c1b7445dd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.229082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2596-d114-4754-b4e8-9c1b7445dd7a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.229366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2596-d114-4754-b4e8-9c1b7445dd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.229679 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2596-d114-4754-b4e8-9c1b7445dd7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.241819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2596-d114-4754-b4e8-9c1b7445dd7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:30.243268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2596-d114-4754-b4e8-9c1b7445dd7a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:30.251503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e1a58-1162-45f4-91ef-afa014c152cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:30.252961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e1a58-1162-45f4-91ef-afa014c152cb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-3f5a2596-d114-4754-b4e8-9c1b7445dd7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:30.258452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:30.260743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:30.262641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:30.262641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:30.262641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:30.262641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:30.262641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 273/550] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:30.266304 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c25f-417b-45e0-946d-4fda548fe145 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.266592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c25f-417b-45e0-946d-4fda548fe145 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.266866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c25f-417b-45e0-946d-4fda548fe145 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.268618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 274/551] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:00:30.269479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68c25f-417b-45e0-946d-4fda548fe145 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-070e1a58-1162-45f4-91ef-afa014c152cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:30.278728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:30.281522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:30.283852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:30.283852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:30.283852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:30.283852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 278/552] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:30.286440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15c2e-9cf8-44d5-a15c-729112057aec None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.288538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15c2e-9cf8-44d5-a15c-729112057aec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.288538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15c2e-9cf8-44d5-a15c-729112057aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.306338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0db15c2e-9cf8-44d5-a15c-729112057aec None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:30.307779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0db15c2e-9cf8-44d5-a15c-729112057aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:30.375857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68c25f-417b-45e0-946d-4fda548fe145 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.390415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 279/553] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:30.391461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15c2e-9cf8-44d5-a15c-729112057aec None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.411351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.411963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.412240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.412512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.413159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:30.413509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:30.414893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:30.431261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 275/554] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:30.432494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.494042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:30.518770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:30.557380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bd1ea-8431-49b2-9a61-7f0eed2a987b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.570995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15c2e-9cf8-44d5-a15c-729112057aec None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.593522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.594284 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.594561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.594831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.602918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:30.604559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:30.617814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:30.619909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:30.622130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:30.625451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 276/555] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:30.625637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.678257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.678895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.679173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.679443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.680109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:30.680407 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:30.681894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:30.719462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 280/556] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:30.726410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.737510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4665e-c684-42b4-85f0-36bdd8669c87 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.758778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:30.774805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.775389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.775670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.775955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.776693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:30.777001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:30.778485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:30.801493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 277/557] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:30.802379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.843665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b10cdf-5e16-4660-b35a-5cc3c30590a8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.870324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:30.880663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.881292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.881594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.881864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.889933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:30.891379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:30.908168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:30.909672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 281/558] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:30.910605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:30.923248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9a300-457a-4eb8-b5f3-9b0f41206024 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:30.960058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9082a9e-58d9-416c-a365-eff411a80df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:30.960601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9082a9e-58d9-416c-a365-eff411a80df0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.960878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9082a9e-58d9-416c-a365-eff411a80df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.961147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9082a9e-58d9-416c-a365-eff411a80df0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.973865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9082a9e-58d9-416c-a365-eff411a80df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b9082a9e-58d9-416c-a365-eff411a80df0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:30.978667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:30.979831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 278/559] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:30.980957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f0c3-cd92-4ad8-aff9-2861082f4bef None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:30.981720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f0c3-cd92-4ad8-aff9-2861082f4bef None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:30.981720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f0c3-cd92-4ad8-aff9-2861082f4bef None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:30.985535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 279/560] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:30.985535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00f0c3-cd92-4ad8-aff9-2861082f4bef None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.033175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:31.042263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b97e1-965f-4948-8631-695a23d70a4d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.082411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.083137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.083488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.083824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.096299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:31.098042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:31.100844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00f0c3-cd92-4ad8-aff9-2861082f4bef None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:31.113185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:31.114377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:31.115519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:31.115519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:31.115519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:31.120543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 282/561] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:31.120543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.144357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18b255-8f9d-49fd-ae78-1e0662476b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.144963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b255-8f9d-49fd-ae78-1e0662476b09 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.145242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b255-8f9d-49fd-ae78-1e0662476b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.145554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18b255-8f9d-49fd-ae78-1e0662476b09 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.146286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18b255-8f9d-49fd-ae78-1e0662476b09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:31.146591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18b255-8f9d-49fd-ae78-1e0662476b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:31.148020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18b255-8f9d-49fd-ae78-1e0662476b09 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:31.164194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:31.166042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 280/562] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 8 01:00:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:31.167230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd38ceb-736c-43d7-ae33-7ea17f2a154b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.167513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd38ceb-736c-43d7-ae33-7ea17f2a154b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.167788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd38ceb-736c-43d7-ae33-7ea17f2a154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.186607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9dd38ceb-736c-43d7-ae33-7ea17f2a154b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:31.187806 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9dd38ceb-736c-43d7-ae33-7ea17f2a154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:31.229262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71094f46-6cdc-42d8-b397-75f5940eacbe None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.255310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 281/563] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:31.256096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd38ceb-736c-43d7-ae33-7ea17f2a154b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.283147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b81fc-c3c3-4317-a319-8ffdf26ec44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.283763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b81fc-c3c3-4317-a319-8ffdf26ec44f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.284044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b81fc-c3c3-4317-a319-8ffdf26ec44f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.284313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b81fc-c3c3-4317-a319-8ffdf26ec44f None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.284974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b81fc-c3c3-4317-a319-8ffdf26ec44f None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:31.285276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b81fc-c3c3-4317-a319-8ffdf26ec44f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:31.286725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b81fc-c3c3-4317-a319-8ffdf26ec44f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:31.289535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:31.296508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 283/564] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:31.297734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29741fe2-1f09-4745-95be-abae76a0c27e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.298020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29741fe2-1f09-4745-95be-abae76a0c27e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.298294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29741fe2-1f09-4745-95be-abae76a0c27e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.303388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 284/565] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:31.303388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29741fe2-1f09-4745-95be-abae76a0c27e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.384230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd38ceb-736c-43d7-ae33-7ea17f2a154b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.419200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:31.424667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29741fe2-1f09-4745-95be-abae76a0c27e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.426841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.427481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.427762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.428038 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.428686 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:31.428991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:31.430389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:31.443955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 282/566] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:31.444556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.464613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461155be-769c-43c3-9a10-3d492491846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.465222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461155be-769c-43c3-9a10-3d492491846d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.465529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461155be-769c-43c3-9a10-3d492491846d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.465799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461155be-769c-43c3-9a10-3d492491846d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.539171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:31.541172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461155be-769c-43c3-9a10-3d492491846d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:31.542769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461155be-769c-43c3-9a10-3d492491846d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:31.554719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747187-6414-4a44-b6e4-2cb1e221fc81 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.589016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ed3b0-d131-4a81-aede-2982cbc98c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.589674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed3b0-d131-4a81-aede-2982cbc98c2f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.589956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed3b0-d131-4a81-aede-2982cbc98c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.590236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed3b0-d131-4a81-aede-2982cbc98c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.601276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ed3b0-d131-4a81-aede-2982cbc98c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:31.602747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ed3b0-d131-4a81-aede-2982cbc98c2f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b83ed3b0-d131-4a81-aede-2982cbc98c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:31.616482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:31.617584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:31.618469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:31.618469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:31.618469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:31.618469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 283/567] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:31.619066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b982-9352-4205-9148-569c4cdc37cd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.619303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b982-9352-4205-9148-569c4cdc37cd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.619574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b982-9352-4205-9148-569c4cdc37cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.637252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f954b982-9352-4205-9148-569c4cdc37cd None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:31.638738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f954b982-9352-4205-9148-569c4cdc37cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:31.645028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:31.649893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 285/568] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:31.651001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461155be-769c-43c3-9a10-3d492491846d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.705306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 284/569] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:31.705995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954b982-9352-4205-9148-569c4cdc37cd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.759889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461155be-769c-43c3-9a10-3d492491846d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.782296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:31.795030 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.796272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.796551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.796822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.803560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:31.805000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:31.816652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:31.817569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:31.818495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 286/570] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:31.818974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.824693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954b982-9352-4205-9148-569c4cdc37cd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.861536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458e3be-7231-4479-abfc-5e35ff116481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.862161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458e3be-7231-4479-abfc-5e35ff116481 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.862440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458e3be-7231-4479-abfc-5e35ff116481 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.862713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458e3be-7231-4479-abfc-5e35ff116481 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.873152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458e3be-7231-4479-abfc-5e35ff116481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c458e3be-7231-4479-abfc-5e35ff116481 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:31.877975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:31.878902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:31.879731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 285/571] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:31.880414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458e3be-7231-4479-abfc-5e35ff116481 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:31.890528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:31.938456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46655b5d-37ee-43d0-b813-58f7bf0b6020 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.975352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4279558-af40-4773-9863-36741e101214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:31.975997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279558-af40-4773-9863-36741e101214 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:31.976273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279558-af40-4773-9863-36741e101214 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:31.976528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279558-af40-4773-9863-36741e101214 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:31.977286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4279558-af40-4773-9863-36741e101214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:31.977612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4279558-af40-4773-9863-36741e101214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:31.978984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4279558-af40-4773-9863-36741e101214 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:31.986915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458e3be-7231-4479-abfc-5e35ff116481 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:31.990937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 287/572] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:31.991720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4279558-af40-4773-9863-36741e101214 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.013874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.022674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.023296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.023577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.023848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.034049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.035499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:32.050446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:32.051491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:32.052402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:32.052402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:32.052402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:32.052402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 286/573] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:32.052402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.094169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4279558-af40-4773-9863-36741e101214 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.113350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.127684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.128283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.128567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.128837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.129549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:32.129872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.131262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.143187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 288/574] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:32.143964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.156830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3983f-5d96-4490-8d76-083a04538b5e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.189838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.190436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.190716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.190995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.191653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:32.191962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.193318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.200909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 287/575] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:32.202224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.240855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173802-a923-41b3-972f-c2d682464b80 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.243559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.274490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260d340-36db-4b8d-9f81-9a490be54654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.275044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260d340-36db-4b8d-9f81-9a490be54654 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.275319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260d340-36db-4b8d-9f81-9a490be54654 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.275583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260d340-36db-4b8d-9f81-9a490be54654 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.285884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260d340-36db-4b8d-9f81-9a490be54654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7260d340-36db-4b8d-9f81-9a490be54654 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:32.291170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:32.292257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:32.293212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 289/576] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:32.294081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260d340-36db-4b8d-9f81-9a490be54654 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.305858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3d672-8130-4f02-bd3e-9d18c66d558b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.333075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.338853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.339474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.339752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.340024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.347594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.349028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:32.360518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:32.361462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 288/577] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:32.362473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.395231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260d340-36db-4b8d-9f81-9a490be54654 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.428616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.429212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.429529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.429806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.430430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:32.430735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.432110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.443373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 290/578] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:32.444155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.460437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfad5-7e93-411b-a644-9a1e068f91e2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.461973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.493837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d5050-46f0-4637-9123-7c8b25a9c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.494488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d5050-46f0-4637-9123-7c8b25a9c941 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.494768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d5050-46f0-4637-9123-7c8b25a9c941 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.495040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d5050-46f0-4637-9123-7c8b25a9c941 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/1b9f7c644bde4c94a8cfe5ec13e782c3/roles/2c6f5ddd2cca40019b4efa72a509dfd2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.509819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d5050-46f0-4637-9123-7c8b25a9c941 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=1b9f7c644bde4c94a8cfe5ec13e782c3, role_id=2c6f5ddd2cca40019b4efa72a509dfd2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.511258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d5050-46f0-4637-9123-7c8b25a9c941 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.525603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 289/579] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:00:32 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/1b9f7c644bde4c94a8cfe5ec13e782c3/roles/2c6f5ddd2cca40019b4efa72a509dfd2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:32.526709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d5050-46f0-4637-9123-7c8b25a9c941 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.548032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.551575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb68b-8037-466d-bb2b-a43ca94616e0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.590064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.590954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.591297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.591630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.604597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.606206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:32.623161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:32.624623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:32.625864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:32.625864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:32.625864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:32.626644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 291/580] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:32.627496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.663868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d5050-46f0-4637-9123-7c8b25a9c941 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.706831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.707589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.707960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.708236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.708905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:32.709371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.711579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.722131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 290/581] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:32.722952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.739940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.746241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7e915-4064-4fe4-91dd-9877274a95d3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.788597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.789120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.789437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.789698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.790483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:32.790790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.792229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.814596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 292/582] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:32.814596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.827159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.837899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553d6a4-e35c-4c16-bcbb-08e92c48d6b1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.876558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.877296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.877610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.877888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.885281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.886762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:32.899913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:32.900844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:32.901782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 291/583] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:32.902818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:32.935142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5b6fb-457b-4f41-b7d2-65e04479918f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:32.973587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:32.974186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:32.974462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:32.974959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:32.975356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:32.975652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:32.977023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:32.990538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 293/584] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:32.991931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:32.995399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.019817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5abe2-d746-467f-b0ea-bba114ae8532 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.053738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.054301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.054567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.054840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.065299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.066782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.068848 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:33.081895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:33.083041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:33.084137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:33.084137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:33.084137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:33.087744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 292/585] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:33.088371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.107501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967b37c-da21-4e8b-b8ea-d88d039dc88c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.147308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.147939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.148210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.148482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.159916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.161340 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:33.176010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:33.177133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:33.178038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:33.178038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:33.178038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:33.178038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 294/586] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:33.178038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.204203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2562f15-3962-456f-8a80-76e4e6520b5b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.232593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:33.245605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.246057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.246669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.247052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.247958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:33.248938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.250501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.265626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 293/587] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:33.266604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.293371 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc636a-9f15-4e31-b91d-36034125184b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.316370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:33.328854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.329507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.329785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.330134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.337864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.339290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:33.351099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:33.352225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 01:00:33.353338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:33.356894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 295/588] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:33.357546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.380059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd064a-98e3-44bf-bb43-982876aacf13 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.418490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.419104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.419389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.419666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.420321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:33.421223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.422680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.435884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 294/589] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:33.436893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.462181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce279ca-dc40-4877-988b-11fb5f95c2a8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.490458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:33.498768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.499503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.499906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.500360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.501234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:33.501662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.503203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.517020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 296/590] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:33.517745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.559220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e80e7d-a7d5-4dcc-b6f6-81c4ee484d71 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.562503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:33.597886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.598720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.599142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.599544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.600261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=3c3d9f448692440fbeee652da473fd05) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:33.600565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.602023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.608145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 295/591] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/role_assignments?user.id=3c3d9f448692440fbeee652da473fd05&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:33.608969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.620849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42432b09-a103-4b8c-b7b4-42ea33bc158f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.665557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.666226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.666505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.666776 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.667527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:33.667833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.669384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.695302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 297/592] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:33.696298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.737926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0efb56-ff4d-4019-9e47-bbbc3480e890 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.750484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:33.779631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.780725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.781230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.781734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.790393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.792137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:33.806400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:33.807362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 01:00:33.808262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:33.809986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4af4e5-83b2-4b0e-b445-7cc8e6f35b52 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.816041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 296/593] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:33.816219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:33.816298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.854200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.854806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.855093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.855357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.864466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:33.865947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:33.880574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:33.881520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:33.882406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:33.882406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:33.882406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:33.882406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:33.882406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:33.882406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:33.882406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:33.882406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:33.885485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 298/594] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:33.886604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:33.943180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0023b-7578-4d23-aa7d-3de889baba48 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:33.983153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:33.983944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:33.984582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:33.984955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:33.999479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.001261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.015922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d53e8-7f24-47ea-9132-adcda6e8a140 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:34.018501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:34.019591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:34.020485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:34.020485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:34.020485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:34.021619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 297/595] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:34.022901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.051756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.052490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.052912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.053192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.053957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:34.054227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:34.054326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.055850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.078305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 299/596] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Sep 8 01:00:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:34.079170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.102667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:34.159751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee4fb5-4d21-47af-92c1-c17a873c5ad1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.196939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.197963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.198450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.199029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.200023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:34.200530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.202232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.202456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e2d1-e580-4865-9148-0ce3c5645f06 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.215940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 298/597] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:34.217109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.240205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.240857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.241142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.241436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.242090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:34.242392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.244574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.261877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 300/598] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:34.262770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.314695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:34.336682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b410c27-d867-44f2-a07b-82db653f485b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.358304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:34.380630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.381659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.381770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca2c93-2f48-4562-b495-44bbaaf9e691 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.382245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.382742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.399228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.401522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:34.418543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:34.419471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:34.420381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:34.420381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:34.420381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:34.420562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6987-beca-47ce-ae34-2a142ab80e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.420562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6987-beca-47ce-ae34-2a142ab80e08 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.420562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6987-beca-47ce-ae34-2a142ab80e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.420562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6987-beca-47ce-ae34-2a142ab80e08 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/274ba5fef7d24d97ac97c33a68bb6aec/roles/2c6f5ddd2cca40019b4efa72a509dfd2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.422973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 299/599] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:34.424102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.440241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6987-beca-47ce-ae34-2a142ab80e08 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=274ba5fef7d24d97ac97c33a68bb6aec, role_id=2c6f5ddd2cca40019b4efa72a509dfd2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.441734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6987-beca-47ce-ae34-2a142ab80e08 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.456997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 301/600] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:00:34 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/274ba5fef7d24d97ac97c33a68bb6aec/roles/2c6f5ddd2cca40019b4efa72a509dfd2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:34.457767 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6987-beca-47ce-ae34-2a142ab80e08 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.582104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18660b78-f41f-4740-8a03-ad8d6204c149 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.584264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6987-beca-47ce-ae34-2a142ab80e08 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.618041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:34.625910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.627134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.633443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.633443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.633443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:34.633443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.633443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.645240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 302/601] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:34.651270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.676071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.676772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.677187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.677510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.679683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:34.688432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.690246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:34.707548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:34.708637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:34.709753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 300/602] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:34.714632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.777041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3513-3ebe-441c-bed6-d574f47ba0bf None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.833898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d21a9-89b4-4da5-9264-74cfdc2b77f6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:34.836358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94b94c-7922-4aaf-946b-303828b254de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.837111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94b94c-7922-4aaf-946b-303828b254de None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.837515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94b94c-7922-4aaf-946b-303828b254de None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.837948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94b94c-7922-4aaf-946b-303828b254de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.852658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94b94c-7922-4aaf-946b-303828b254de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.854406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94b94c-7922-4aaf-946b-303828b254de None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ee94b94c-7922-4aaf-946b-303828b254de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:34.867506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:34.868572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:34.869673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:34.869673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:34.869673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:34.869673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:34.869673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:34.869673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:34.869673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:34.869673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:34.871233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 303/603] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:34.871349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260d86b-fef9-4e87-adc3-c8d22c951a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:34.871996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d86b-fef9-4e87-adc3-c8d22c951a3f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.872338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d86b-fef9-4e87-adc3-c8d22c951a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.872620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d86b-fef9-4e87-adc3-c8d22c951a3f None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.873329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260d86b-fef9-4e87-adc3-c8d22c951a3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:34.874213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260d86b-fef9-4e87-adc3-c8d22c951a3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:34.875634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260d86b-fef9-4e87-adc3-c8d22c951a3f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:34.877434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392a4df-9b70-41de-af6c-a0e022d4a33b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.877825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392a4df-9b70-41de-af6c-a0e022d4a33b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.878533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392a4df-9b70-41de-af6c-a0e022d4a33b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.880044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 304/604] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:34.881723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392a4df-9b70-41de-af6c-a0e022d4a33b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:34.888984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 301/605] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:34.890923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc415a4-0fab-40f7-be2c-db1d3e181146 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:34.895889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc415a4-0fab-40f7-be2c-db1d3e181146 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:34.896257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc415a4-0fab-40f7-be2c-db1d3e181146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:34.917316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5bc415a4-0fab-40f7-be2c-db1d3e181146 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:34.918645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5bc415a4-0fab-40f7-be2c-db1d3e181146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:34.946157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:34.976759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:34.997995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 302/606] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:35.000073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc415a4-0fab-40f7-be2c-db1d3e181146 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:35.022290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392a4df-9b70-41de-af6c-a0e022d4a33b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:35.057980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:35.058759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:35.059119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:35.059498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:35.060291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:35.060727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:35.062298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:35.074727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 305/607] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:35.080856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:35.126915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc415a4-0fab-40f7-be2c-db1d3e181146 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:35.200976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1183dc8-98d9-46f9-83e5-f659074d2ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:35.202537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183dc8-98d9-46f9-83e5-f659074d2ca0 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:35.203596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183dc8-98d9-46f9-83e5-f659074d2ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:35.204142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183dc8-98d9-46f9-83e5-f659074d2ca0 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/21d637726e3142e6ba90fa201c764b0b/roles/2c6f5ddd2cca40019b4efa72a509dfd2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:35.236762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1183dc8-98d9-46f9-83e5-f659074d2ca0 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=21d637726e3142e6ba90fa201c764b0b, role_id=2c6f5ddd2cca40019b4efa72a509dfd2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:35.242093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9beb-8d26-4f28-ba9d-ca4924730ccb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:35.242946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1183dc8-98d9-46f9-83e5-f659074d2ca0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:35.261159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:35.271895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 303/608] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:00:34 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/21d637726e3142e6ba90fa201c764b0b/roles/2c6f5ddd2cca40019b4efa72a509dfd2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:35.323504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6060096-885f-421d-8d03-7a2b188af716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:35.324393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060096-885f-421d-8d03-7a2b188af716 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:35.324870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060096-885f-421d-8d03-7a2b188af716 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:35.325365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6060096-885f-421d-8d03-7a2b188af716 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/5a6ff1b9371a411bae7b3e45f78e05e6/roles/2c6f5ddd2cca40019b4efa72a509dfd2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:35.353096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6060096-885f-421d-8d03-7a2b188af716 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=5a6ff1b9371a411bae7b3e45f78e05e6, role_id=2c6f5ddd2cca40019b4efa72a509dfd2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:35.361296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6060096-885f-421d-8d03-7a2b188af716 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:35.382003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 306/609] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:00:35 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/5a6ff1b9371a411bae7b3e45f78e05e6/roles/2c6f5ddd2cca40019b4efa72a509dfd2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:00:35.436855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1183dc8-98d9-46f9-83e5-f659074d2ca0 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:35.488380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:35.572740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1183dc8-98d9-46f9-83e5-f659074d2ca0 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:35.615250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f838d96-bbad-4b3b-be0b-f58aeaf96567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:35.615895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838d96-bbad-4b3b-be0b-f58aeaf96567 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:35.616175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838d96-bbad-4b3b-be0b-f58aeaf96567 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:35.616450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838d96-bbad-4b3b-be0b-f58aeaf96567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:35.630579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f838d96-bbad-4b3b-be0b-f58aeaf96567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4f838d96-bbad-4b3b-be0b-f58aeaf96567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:35.635680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:35.636700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:35.637577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 304/610] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:35.646557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6060096-885f-421d-8d03-7a2b188af716 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:35.777884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6060096-885f-421d-8d03-7a2b188af716 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:35.815242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dff8c-d293-41bf-a01e-27eda4435fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:35.816216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dff8c-d293-41bf-a01e-27eda4435fdd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:35.816753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dff8c-d293-41bf-a01e-27eda4435fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:35.817217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dff8c-d293-41bf-a01e-27eda4435fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:35.818091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dff8c-d293-41bf-a01e-27eda4435fdd None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:35.818592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dff8c-d293-41bf-a01e-27eda4435fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:35.820154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dff8c-d293-41bf-a01e-27eda4435fdd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:35.829771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 307/611] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:35.835791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f838d96-bbad-4b3b-be0b-f58aeaf96567 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:35.915416 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657993b-c726-4262-8cb6-62c0dc3cdcb1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:35.916100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657993b-c726-4262-8cb6-62c0dc3cdcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:35.916602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657993b-c726-4262-8cb6-62c0dc3cdcb1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:35.918469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 308/612] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:35.928132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e492c-ecbe-462a-8a4d-e6a4ecb7ff4c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:35.928404 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e492c-ecbe-462a-8a4d-e6a4ecb7ff4c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:35.928681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e492c-ecbe-462a-8a4d-e6a4ecb7ff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:35.942661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:35.949827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5b7e492c-ecbe-462a-8a4d-e6a4ecb7ff4c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:35.950000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f838d96-bbad-4b3b-be0b-f58aeaf96567 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:35.952090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5b7e492c-ecbe-462a-8a4d-e6a4ecb7ff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:35.968389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:35.995085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:35.995731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:35.996011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:35.996288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:36.015408 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:36.017117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:36.033913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:36.034875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:36.035787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:36.035787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:36.035787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:36.035787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 305/613] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:36.046210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:36.068511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 309/614] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 01:00:36.158008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d6770-5db7-43a9-b9a0-288d5f9eaeee None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:36.200816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:36.201468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:36.202296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:36.202576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:36.203232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:36.203540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:36.204915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:36.221613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 306/615] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:36.227180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e492c-ecbe-462a-8a4d-e6a4ecb7ff4c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:36.373892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e492c-ecbe-462a-8a4d-e6a4ecb7ff4c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:36.423773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:36.424409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:36.424688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:36.424966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:36.436561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:36.438050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:36.441993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:36.453639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:36.456042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:36.458379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 310/616] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:00:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:36.459716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:36.462178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:36.481045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:36.571501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cea27-0ae1-4fae-a4aa-b894ea49bec6 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:36.626487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffdf72-c464-4f42-9cd9-26a14a46ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:36.627914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffdf72-c464-4f42-9cd9-26a14a46ed15 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:36.627914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffdf72-c464-4f42-9cd9-26a14a46ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:36.628285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffdf72-c464-4f42-9cd9-26a14a46ed15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:36.653780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffdf72-c464-4f42-9cd9-26a14a46ed15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:36.663627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b8c37-1283-4504-9570-aaf98e14d846 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-42ffdf72-c464-4f42-9cd9-26a14a46ed15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:36.671394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:36.672359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:36.673643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 307/617] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:36.680841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffdf72-c464-4f42-9cd9-26a14a46ed15 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:36.705547 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:36.706891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:36.707382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:36.707855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:36.708818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:36.709437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:36.711428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:36.732921 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 311/618] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:36.739405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:36.813249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:36.836446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:36.880402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696f770-26a7-438e-9eb6-d4c19033c2f9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:36.905210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffdf72-c464-4f42-9cd9-26a14a46ed15 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:36.950999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fea303-6d01-453a-9132-dbec833c07d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:36.952646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea303-6d01-453a-9132-dbec833c07d6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:36.953694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea303-6d01-453a-9132-dbec833c07d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:36.955375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fea303-6d01-453a-9132-dbec833c07d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:36.978279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:36.979399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:36.979936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:36.980470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:36.981558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:36.982086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:36.983750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.005819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 308/619] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:37.012940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:37.083836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fea303-6d01-453a-9132-dbec833c07d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:37.085327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fea303-6d01-453a-9132-dbec833c07d6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.132829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e4870-a18a-4b36-a81f-8ea547bf670a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:37.161929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:37.164205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:37.173151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:37.174137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.174604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.175057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.187216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:37.188906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:37.203762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:37.204892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:37.205998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:37.205998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:37.205998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:37.209265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 312/621] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:37.210700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e273f-39ac-4c42-bd81-a585dbc97ff7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.211133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e273f-39ac-4c42-bd81-a585dbc97ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.211540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e273f-39ac-4c42-bd81-a585dbc97ff7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.213122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 313/622] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:37.213569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 309/622] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:37.214327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e273f-39ac-4c42-bd81-a585dbc97ff7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:37.217712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:37.328831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e273f-39ac-4c42-bd81-a585dbc97ff7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:37.334532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47536c3c-7b46-46a1-8a2d-3cac2cf4a8f5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:37.365886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:37.366340 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.366623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.366897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.375230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1c40d-0438-406e-b50f-4dd5f356c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:37.376390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c40d-0438-406e-b50f-4dd5f356c0df None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.377117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c40d-0438-406e-b50f-4dd5f356c0df None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.377619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c40d-0438-406e-b50f-4dd5f356c0df None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.377737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:37.378875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1c40d-0438-406e-b50f-4dd5f356c0df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:37.379232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.379561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1c40d-0438-406e-b50f-4dd5f356c0df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:37.381088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1c40d-0438-406e-b50f-4dd5f356c0df None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.394558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 310/623] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:37.395977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1747-b5c1-43c0-a433-133b3d7a026f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.396440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1747-b5c1-43c0-a433-133b3d7a026f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.396896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1747-b5c1-43c0-a433-133b3d7a026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:37.401613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:37.402519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:37.403386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:37.403386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:37.403386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:37.403386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 314/624] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:37.403814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:37.420807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5ded1747-b5c1-43c0-a433-133b3d7a026f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:37.422151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5ded1747-b5c1-43c0-a433-133b3d7a026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:37.437079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:37.466034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:37.502589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 311/625] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:37.508698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1747-b5c1-43c0-a433-133b3d7a026f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:37.558022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a279bad-92d7-4c22-9db1-9ddb8d3ccf45 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:37.605619 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:37.606774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.607599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.608613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.619521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:37.622198 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.624223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1747-b5c1-43c0-a433-133b3d7a026f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:37.637458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:37.638731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:37.639705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:37.642561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 315/626] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:37.648475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:37.673877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:37.674596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.674880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.675152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.675826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:37.676162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:37.677781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.705938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 312/627] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:37.714276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:37.754760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:37.766330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcc420-8546-447d-a2f3-84d668b9f9dc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:37.769203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:37.806896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:37.807944 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.808444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.808979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.809987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:37.810510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:37.812678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.832611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 316/628] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:37.838565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:37.866767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4544dcb-6802-422d-819e-4065bdca3866 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:37.914805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:37.915308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:37.915652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:37.915935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:37.923526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:37.924672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:37.948745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:37.949969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:37.950869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 313/629] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:37.954647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3f67-a5b8-433b-9ab8-ffbb2b575f24 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:37.956921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.016540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.017436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.017571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.018772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.025802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:38.029907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:38.031496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:38.048403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:38.049620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:38.050725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:38.050725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:38.050725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:38.052381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 317/630] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:38.057332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.107451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:38.118818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c340ba-2782-4e26-97e1-678a298a7197 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.152456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.153054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.153331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.153638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.154323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:38.154657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:38.156076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:38.158769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15220-0a49-4fc4-a880-1e469e6a6fee None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.167694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 314/631] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:38.168423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.197226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ab8f6-7ba8-406c-acc0-bc6da9d91046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.197889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab8f6-7ba8-406c-acc0-bc6da9d91046 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.198174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab8f6-7ba8-406c-acc0-bc6da9d91046 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.198443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab8f6-7ba8-406c-acc0-bc6da9d91046 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.208608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ab8f6-7ba8-406c-acc0-bc6da9d91046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-212ab8f6-7ba8-406c-acc0-bc6da9d91046 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:38.213896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:38.214954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:38.215880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 318/632] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:38.216865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d98c9-66b5-45af-8830-ade6e7f59374 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.216865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d98c9-66b5-45af-8830-ade6e7f59374 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.216865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d98c9-66b5-45af-8830-ade6e7f59374 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.218042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 319/633] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:38.218909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c08d4-c9f4-4c51-a863-1c875230c4e0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.219194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c08d4-c9f4-4c51-a863-1c875230c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.219481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c08d4-c9f4-4c51-a863-1c875230c4e0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.224949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 320/634] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:38.224949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c08d4-c9f4-4c51-a863-1c875230c4e0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.269732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6b4a4-78da-4cd4-ac5b-84ddf3a52671 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.273367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:38.313884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd0cb-e131-4c65-b68c-0b4819a7df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.314949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd0cb-e131-4c65-b68c-0b4819a7df4a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.315466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd0cb-e131-4c65-b68c-0b4819a7df4a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.315818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd0cb-e131-4c65-b68c-0b4819a7df4a None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.316480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd0cb-e131-4c65-b68c-0b4819a7df4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:38.316791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd0cb-e131-4c65-b68c-0b4819a7df4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:38.318195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd0cb-e131-4c65-b68c-0b4819a7df4a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:38.327132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c08d4-c9f4-4c51-a863-1c875230c4e0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.332964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 315/635] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:38.334471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cce34-8ad7-4db1-8019-dcf958f9d312 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.334873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cce34-8ad7-4db1-8019-dcf958f9d312 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.335151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cce34-8ad7-4db1-8019-dcf958f9d312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.352951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-992cce34-8ad7-4db1-8019-dcf958f9d312 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:38.354176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-992cce34-8ad7-4db1-8019-dcf958f9d312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:38.356927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:38.364774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.365375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.365684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.365957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.366666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=1b9f7c644bde4c94a8cfe5ec13e782c3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:38.366971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:38.368368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:38.374691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 321/636] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/role_assignments?user.id=1b9f7c644bde4c94a8cfe5ec13e782c3&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:38.375637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.447007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 316/637] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:38.448654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd845-59b7-430e-815f-ebcc2d49e5d3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.449162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd845-59b7-430e-815f-ebcc2d49e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.449673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd845-59b7-430e-815f-ebcc2d49e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.471394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5aedd845-59b7-430e-815f-ebcc2d49e5d3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:38.472956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5aedd845-59b7-430e-815f-ebcc2d49e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:38.536975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b421d7-c77d-48e9-a426-cf9e076754fd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.557240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:38.558444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 317/638] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:38.558937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedd845-59b7-430e-815f-ebcc2d49e5d3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.594802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.595873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.596380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.596853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.597781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:38.598286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:38.600029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:38.610480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 322/639] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:38.616669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.644833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:38.681283 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedd845-59b7-430e-815f-ebcc2d49e5d3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.719348 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.720233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.720520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.720841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.728741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:38.730229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2292-b98a-4493-a325-f326dcc38470 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.730360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:38.741979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:38.742957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:38.743810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 318/640] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:38.749629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.780758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.781394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.781751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.782028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.794559 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:38.796546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:38.815312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:38.816466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:38.817598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:38.817598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:38.817598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:38.818085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 323/641] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:38.819122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.854086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:38.886607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5484aad-18ae-489e-882f-9c07db54bb5a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.924356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:38.931721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.932472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.932752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.933023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.933743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:38.934209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:38.936513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:38.939924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a4b93-de9a-4e68-9ded-43b94c5b520e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:38.954046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 319/642] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:38.954046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:38.985498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59361-49c1-4b68-a803-61479243d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:38.986266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59361-49c1-4b68-a803-61479243d31e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:38.986487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59361-49c1-4b68-a803-61479243d31e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:38.986754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59361-49c1-4b68-a803-61479243d31e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:38.998317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a59361-49c1-4b68-a803-61479243d31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a1a59361-49c1-4b68-a803-61479243d31e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:39.003397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:39.004550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 324/643] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:39.005657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59361-49c1-4b68-a803-61479243d31e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.065870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41eb215-608a-4b9f-974d-0c40b5d85ffd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.102135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:39.102676 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.103289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.103587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.103864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.104557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:39.104862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.106245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.116667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59361-49c1-4b68-a803-61479243d31e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.124006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 320/644] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:39.124006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.157293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf20ba-1534-48af-9105-4771cbae500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.157953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf20ba-1534-48af-9105-4771cbae500a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.158231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf20ba-1534-48af-9105-4771cbae500a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.158498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf20ba-1534-48af-9105-4771cbae500a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.170302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf20ba-1534-48af-9105-4771cbae500a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:39.174623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9aaf20ba-1534-48af-9105-4771cbae500a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:39.175531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:39.176410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 325/645] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:39.178446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf20ba-1534-48af-9105-4771cbae500a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.239436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4438d-5425-4b7e-af4f-3082a83e4854 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.281990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf20ba-1534-48af-9105-4771cbae500a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.282914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3ad39-076e-4106-86d8-715dd6e1845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.283721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3ad39-076e-4106-86d8-715dd6e1845f None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.284000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3ad39-076e-4106-86d8-715dd6e1845f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.285027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3ad39-076e-4106-86d8-715dd6e1845f None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/3c3d9f448692440fbeee652da473fd05/roles/2c6f5ddd2cca40019b4efa72a509dfd2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.308968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3ad39-076e-4106-86d8-715dd6e1845f None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=3c3d9f448692440fbeee652da473fd05, role_id=2c6f5ddd2cca40019b4efa72a509dfd2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.310447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3ad39-076e-4106-86d8-715dd6e1845f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.318178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.318787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.319143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.319539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.320189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:39.320489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.321880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.334334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 321/646] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:00:39 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/3c3d9f448692440fbeee652da473fd05/roles/2c6f5ddd2cca40019b4efa72a509dfd2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:39.334334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3ad39-076e-4106-86d8-715dd6e1845f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.334632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 326/647] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:39.334632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.346479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:39.460181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7d2cc-19a4-46f8-b0f2-d12ef357f7f7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.494239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:39.499044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3ad39-076e-4106-86d8-715dd6e1845f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.499360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.499961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.500239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.500508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.501302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:39.501721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.503403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.521500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 327/648] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:39.522739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.559142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.559781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.560063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.560334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.569395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.571173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:39.590125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:39.591110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 01:00:39.592162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:39.599174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 322/649] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:39.599174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.627685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:39.671237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2febc5-6c37-48da-bb42-87ed5e4c6e6d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.709071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.709443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.709723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.710098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.722339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff1e40-7e2e-4b45-b8c5-0d485c9a584d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.724259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.725855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:39.741956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:39.742918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:39.744190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:39.744190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:39.744190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:39.744190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 328/650] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:39.744190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.764486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.765471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.765963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.766700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.779658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.781581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:39.798193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:39.799140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:39.799991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:39.799991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:39.799991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:39.807105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 323/651] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:39.807105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.828282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:39.877046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fa13c-4d28-4821-a562-6fcacd2e059b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.902898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:39.921435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.921435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.921435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.921435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.922120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:39.922430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.923984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.939705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef9e7b-f8ae-4084-a945-39a12609c7c8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:39.944657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 329/652] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:39.945597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:39.975315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:39.975920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:39.976198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:39.976472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:39.977111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:39.977424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:39.978808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:39.991575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 324/653] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:39.992375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:40.076178 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:40.081541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3948-b60e-4b9b-aacc-e9ed9419a2f7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.119041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:40.119702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:40.119982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:40.120259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:40.120513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd034-214c-4ea7-9656-0a67d4f1aa08 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.120951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:40.121308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:40.122867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:40.137646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 330/654] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:40.139510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:40.164689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189a34-79cb-4e78-9142-8c3f45768086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:40.166010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189a34-79cb-4e78-9142-8c3f45768086 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:40.166290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189a34-79cb-4e78-9142-8c3f45768086 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:40.166561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189a34-79cb-4e78-9142-8c3f45768086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:40.192913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:40.264697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189a34-79cb-4e78-9142-8c3f45768086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:40.266785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189a34-79cb-4e78-9142-8c3f45768086 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:40.266924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4accf-7592-4cdb-9c04-e07835be2dbc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.304652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:40.305665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:40.306004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:40.306278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:40.316145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:40.317607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:40.332254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:40.333386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 01:00:40.334585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:40.337484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 331/655] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:40.338436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:40.360087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:40.404490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 325/656] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:40.406133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189a34-79cb-4e78-9142-8c3f45768086 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:40.465123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d36826-3bd8-48de-b576-3198c335bc6c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.466946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:40.506945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:40.507611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:40.507889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:40.508160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:40.517478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:40.519035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:40.531459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:40.532612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 01:00:40.533774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:40.535221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 332/657] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:40.536061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:40.544635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189a34-79cb-4e78-9142-8c3f45768086 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.589503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:40.590306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:40.590703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:40.591065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:40.591893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:40.592411 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:40.593965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:40.624882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 326/658] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Sep 8 01:00:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:40.626022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:40.662019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3eb51-4313-4d27-a6a6-bb7d869efa5c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.665448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:40.698819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:40.699659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:40.700031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:40.700447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:40.711889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:40.713448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:40.728677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:40.729941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:40.730825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:40.730825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:40.730825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:40.731451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 333/659] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:40.732429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:40.751822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:40.767954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825abcb-a63a-4ae1-b959-8100309483d2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.815984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:40.816902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:40.817392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:40.818423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:40.819418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:40.819955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:40.822547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:40.845802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e914-25f0-4cc6-8ddb-2af61a54b269 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.847734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 327/660] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Sep 8 01:00:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:40.849626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:40.882503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4f36-8345-45ba-a4a7-fb670d6b36a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:40.883175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4f36-8345-45ba-a4a7-fb670d6b36a0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:40.883461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4f36-8345-45ba-a4a7-fb670d6b36a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:40.883741 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4f36-8345-45ba-a4a7-fb670d6b36a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:40.949231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:40.954942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4f36-8345-45ba-a4a7-fb670d6b36a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:40.956387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4f36-8345-45ba-a4a7-fb670d6b36a0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:40.963652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2d44-aca9-4a9c-9548-24ae2e88da27 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:40.971210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:41.000751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.001349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.001654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.001929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.002569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:41.002850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.004206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.017228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 328/661] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:41.018276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.068445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 334/662] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:41.073271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03493f-982c-4d68-ac90-7e0c986edad5 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.073271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03493f-982c-4d68-ac90-7e0c986edad5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.073271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03493f-982c-4d68-ac90-7e0c986edad5 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.073271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 335/663] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:41.073271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03493f-982c-4d68-ac90-7e0c986edad5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.134308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0edeb-bda9-43d8-bf16-06a248aa9125 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:41.168445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95e0f9-885d-4998-a283-483c675299e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.169053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e0f9-885d-4998-a283-483c675299e2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.169426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e0f9-885d-4998-a283-483c675299e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.169714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e0f9-885d-4998-a283-483c675299e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.180795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03493f-982c-4d68-ac90-7e0c986edad5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:41.187703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:41.198162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:41.220886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.221653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.221931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.222313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.229163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.230738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.240976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e0f9-885d-4998-a283-483c675299e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.242456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e0f9-885d-4998-a283-483c675299e2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:41.242949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:41.243788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 336/664] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:41.250217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.349084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89204397-4017-49c2-962c-05ad953ed4df None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:41.357167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 329/665] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:41.357167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd950eb0-8409-4d2e-9bbf-9edc182c1239 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.357167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd950eb0-8409-4d2e-9bbf-9edc182c1239 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.357167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd950eb0-8409-4d2e-9bbf-9edc182c1239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.373316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cd950eb0-8409-4d2e-9bbf-9edc182c1239 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:41.374614 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cd950eb0-8409-4d2e-9bbf-9edc182c1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:41.386583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.387219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.387675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.388009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.399260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.401047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:41.417155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:41.418360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:41.419348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:41.419348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:41.419348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:41.419578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:41.421565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 337/666] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:41.421565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.444867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 330/667] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:41.446039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd950eb0-8409-4d2e-9bbf-9edc182c1239 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.460658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:41.561613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cdeb8-a18d-4e8f-b2c6-6e5a8e536942 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:41.577267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd950eb0-8409-4d2e-9bbf-9edc182c1239 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:41.606998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.608754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.609217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.609844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.611583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:41.612401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.614607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.621543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c5fa0-cbcc-4ef2-bd19-30f50720d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.622428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5fa0-cbcc-4ef2-bd19-30f50720d1dc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.622902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5fa0-cbcc-4ef2-bd19-30f50720d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.623797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5fa0-cbcc-4ef2-bd19-30f50720d1dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.629531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 338/668] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:41.630616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.634789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c5fa0-cbcc-4ef2-bd19-30f50720d1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.636343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c5fa0-cbcc-4ef2-bd19-30f50720d1dc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8c5c5fa0-cbcc-4ef2-bd19-30f50720d1dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:41.652984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:41.654145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:41.655577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:41.655577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:41.655577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:41.655577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 331/669] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:41.655808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb10fe-fa80-498f-a60a-d781ed2ef2ea None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.656004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb10fe-fa80-498f-a60a-d781ed2ef2ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.656280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb10fe-fa80-498f-a60a-d781ed2ef2ea None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.657829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 332/670] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:41.658485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb10fe-fa80-498f-a60a-d781ed2ef2ea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.694065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:41.723094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:41.740857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19ebf-25d6-4d12-b2bc-1c035becf1da None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:41.771079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb10fe-fa80-498f-a60a-d781ed2ef2ea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:41.774440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.775104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.775445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.775777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.776472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:41.776840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.778280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.789211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 339/671] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:41.790017 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.808622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce53982-9890-484b-8a24-1c6ed3647ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.809223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce53982-9890-484b-8a24-1c6ed3647ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.809534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce53982-9890-484b-8a24-1c6ed3647ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.809812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce53982-9890-484b-8a24-1c6ed3647ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.810536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce53982-9890-484b-8a24-1c6ed3647ff5 None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=274ba5fef7d24d97ac97c33a68bb6aec) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:41.811410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce53982-9890-484b-8a24-1c6ed3647ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.812844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce53982-9890-484b-8a24-1c6ed3647ff5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.818581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 333/672] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/role_assignments?user.id=274ba5fef7d24d97ac97c33a68bb6aec&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:41.819713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defda1b1-40f7-426f-9908-3db46451ef13 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.819999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defda1b1-40f7-426f-9908-3db46451ef13 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.820339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defda1b1-40f7-426f-9908-3db46451ef13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.840230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-defda1b1-40f7-426f-9908-3db46451ef13 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:41.841702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-defda1b1-40f7-426f-9908-3db46451ef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:41.903466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14daaeb-51f3-48dd-97e1-4697800a1059 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:41.918027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 334/673] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:41.919264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defda1b1-40f7-426f-9908-3db46451ef13 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.950167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:41.950798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:41.951079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:41.951839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:41.952501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:41.952806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:41.954279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:41.959603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:41.979846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 340/674] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:41.979846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:41.990053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:42.052755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defda1b1-40f7-426f-9908-3db46451ef13 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.097975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6de33-5587-4693-8ea7-f7a267074381 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.098793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d15b49-33c0-414c-ad65-d664898c3481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.100979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d15b49-33c0-414c-ad65-d664898c3481 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.101507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d15b49-33c0-414c-ad65-d664898c3481 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.101969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d15b49-33c0-414c-ad65-d664898c3481 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.117134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d15b49-33c0-414c-ad65-d664898c3481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b2d15b49-33c0-414c-ad65-d664898c3481 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:42.123910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:42.124835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:42.125717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:42.127144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 335/675] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:42.129050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d15b49-33c0-414c-ad65-d664898c3481 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.143079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.144556 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.145184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.145688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.156194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:42.158612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:42.175991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:42.176904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:42.177811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:42.177811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:42.177811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:42.177811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:42.177811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:42.177811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:42.177811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:42.177811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:42.183765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 341/676] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:42.183765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.231818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:42.250437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d15b49-33c0-414c-ad65-d664898c3481 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.251334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:42.287717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.288364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.288641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.288917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.291856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c3ff-5a27-48b0-9f80-45d21acea553 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.296227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:42.297684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:42.308995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:42.309912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:42.310840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 336/677] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:42.311330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.335088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.335695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.335976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.336252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.336913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:42.337218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:42.338650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:42.352042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 342/678] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:42.352042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.424651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4efd1-ce93-4ada-b61a-50dd62568ea7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.455264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb93f7-fe41-4a32-a6b2-74617de6bc62 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.462835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.463447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.463727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.464006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.464703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:42.465011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:42.466482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:42.479702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 337/679] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:42.484127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:42.485813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.489602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:42.493816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dca6-3198-47ba-a782-448f9357dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.494443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dca6-3198-47ba-a782-448f9357dcba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.494721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dca6-3198-47ba-a782-448f9357dcba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.495405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dca6-3198-47ba-a782-448f9357dcba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.507959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0dca6-3198-47ba-a782-448f9357dcba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-97a0dca6-3198-47ba-a782-448f9357dcba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:42.514970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:42.515912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:42.516739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 343/680] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:42.517460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dca6-3198-47ba-a782-448f9357dcba None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.601572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b67bb-732e-48c8-be94-58dfa63d03ec None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.626294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dca6-3198-47ba-a782-448f9357dcba None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.642031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.642802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.643086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.643363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.644059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:42.644365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:42.645819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:42.662395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 338/681] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:42.662395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.669355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.670597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.670878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.671148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.682093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:42.683488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:42.698354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:42.699386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:42.700507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:42.700507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:42.700507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:42.700507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 344/682] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:42.700507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.733702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:42.746299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:42.777760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd97ce-ab9b-4f77-a2f6-ce29a9afc320 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.809942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5b2b0-e5fb-4e57-abcc-a86ec68d3eb1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:42.816146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bba96-15f2-437e-9afa-71911af448af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.817140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bba96-15f2-437e-9afa-71911af448af None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.817444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bba96-15f2-437e-9afa-71911af448af None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.817723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bba96-15f2-437e-9afa-71911af448af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.818463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bba96-15f2-437e-9afa-71911af448af None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=5a6ff1b9371a411bae7b3e45f78e05e6) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:42.819101 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bba96-15f2-437e-9afa-71911af448af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:42.820855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bba96-15f2-437e-9afa-71911af448af None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:42.829460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 339/683] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/role_assignments?user.id=5a6ff1b9371a411bae7b3e45f78e05e6&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:42.829460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bba96-15f2-437e-9afa-71911af448af None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.857249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:42.858470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:42.858804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:42.859129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:42.860418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:42.860418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:42.861734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:42.876617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 345/684] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:42.876617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:42.969227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bba96-15f2-437e-9afa-71911af448af None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.004824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:43.007600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ab60e-8d35-47b3-98cf-ad25df030e3e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.009241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:43.020660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.021627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.022072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.022493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.023375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=21d637726e3142e6ba90fa201c764b0b) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:43.023689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.025246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.032371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 340/685] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/role_assignments?user.id=21d637726e3142e6ba90fa201c764b0b&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:43.033320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:43.047463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.048224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.048603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.048974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.050299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:43.050299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.051694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.070792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 346/686] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:43.072264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:43.177979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b951b1-5e9d-4415-90c0-0f83fd642a81 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.199641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91944-e0ec-454a-8141-a79f88b66713 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.231945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.232926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.233378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.233818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.247859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.250205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.252035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.252966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.253704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.253704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:43.266652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:43.267802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:43.268840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:43.268840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:43.268840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:43.268840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 341/687] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:43.269825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.271433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.279293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:43.287574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:43.288551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:43.289502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 347/688] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:00:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:43.294765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:43.346382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:43.353764 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:43.408619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c215ae0-1812-403b-8550-c71072380276 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.420294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a57b-462b-4654-8355-259c1c367198 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.444007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.444647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.444933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.445211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.445889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:43.446190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.447571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.458778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.459703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.460183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.460655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.461714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:43.462225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.463875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.465531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 342/689] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:43.467765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:43.485060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 348/690] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:00:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:43.502867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:43.578759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938840c2-043c-46b5-b104-aed520b51517 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.581105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:43.617353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.618018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.618300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.618575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] PATH_INFO: `/v3/users/swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.626965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.628153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:43.640969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:43.642250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:43.643499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:43.649498 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 343/691] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:43.650095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:43.650873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:43.671793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24d5d5-cbed-4c6e-9c53-67833ffec539 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.742204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ef9ba-89ed-4ca6-97d8-3d4db0a483c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.743175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ef9ba-89ed-4ca6-97d8-3d4db0a483c6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.743601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ef9ba-89ed-4ca6-97d8-3d4db0a483c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.744028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ef9ba-89ed-4ca6-97d8-3d4db0a483c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.758736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa3e6-3a7d-4ae0-aa08-b808fc890afe None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.795011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.795788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.796198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.796574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:43.797497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:43.797935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.799547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.823111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 344/692] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 8 01:00:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:43.824356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:43.853927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:43.881073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ef9ba-89ed-4ca6-97d8-3d4db0a483c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:43.882608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ef9ba-89ed-4ca6-97d8-3d4db0a483c6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:43.929603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a33bda-96b8-46a7-a847-61ea451d4e40 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:43.965694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcc530-2679-4578-be90-2eb18b9dfb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:43.966484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcc530-2679-4578-be90-2eb18b9dfb4c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:43.966897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcc530-2679-4578-be90-2eb18b9dfb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:43.967276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcc530-2679-4578-be90-2eb18b9dfb4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:44.049220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:44.073217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 349/693] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:44.079283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ef9ba-89ed-4ca6-97d8-3d4db0a483c6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:44.097042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcc530-2679-4578-be90-2eb18b9dfb4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:44.098530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcc530-2679-4578-be90-2eb18b9dfb4c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:44.123223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:44.233438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 345/694] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 01:00:44.239308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcc530-2679-4578-be90-2eb18b9dfb4c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:44.304903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ef9ba-89ed-4ca6-97d8-3d4db0a483c6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:44.361068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5379d0-5317-4f7b-89d7-06ea92f746ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:44.361996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5379d0-5317-4f7b-89d7-06ea92f746ba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:44.362283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5379d0-5317-4f7b-89d7-06ea92f746ba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:44.362563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5379d0-5317-4f7b-89d7-06ea92f746ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:44.376695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5379d0-5317-4f7b-89d7-06ea92f746ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:44.378727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5379d0-5317-4f7b-89d7-06ea92f746ba None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:44.395689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcc530-2679-4578-be90-2eb18b9dfb4c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ad5379d0-5317-4f7b-89d7-06ea92f746ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:44.399133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:44.400041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:44.401541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:44.401541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:44.401541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:44.401541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 350/695] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:44.401893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4065-3a80-4a4e-b359-8f95cc92523b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:44.402168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4065-3a80-4a4e-b359-8f95cc92523b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:44.402441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe4065-3a80-4a4e-b359-8f95cc92523b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:44.408417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 351/696] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:44.408417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe4065-3a80-4a4e-b359-8f95cc92523b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:44.429795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:44.444118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475375-763d-40a5-93d5-8c20c43c22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:44.445482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475375-763d-40a5-93d5-8c20c43c22d6 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:44.445969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475375-763d-40a5-93d5-8c20c43c22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:44.446445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475375-763d-40a5-93d5-8c20c43c22d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:44.448124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:44.458770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475375-763d-40a5-93d5-8c20c43c22d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:44.460571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475375-763d-40a5-93d5-8c20c43c22d6 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e8475375-763d-40a5-93d5-8c20c43c22d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:44.481983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:44.483013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:44.483891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:44.483891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:44.483891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:44.490329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 346/697] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:44.491883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d97ff-30dd-4330-bec6-3c8c968ee79c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:44.492389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d97ff-30dd-4330-bec6-3c8c968ee79c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:44.492882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d97ff-30dd-4330-bec6-3c8c968ee79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:44.515307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-890d97ff-30dd-4330-bec6-3c8c968ee79c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:44.516515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-890d97ff-30dd-4330-bec6-3c8c968ee79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:44.557713 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe4065-3a80-4a4e-b359-8f95cc92523b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:44.594267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:44.594914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:44.595197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:44.595473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:44.596173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:44.596490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:44.598055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:44.598861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 347/698] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:44.599942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d97ff-30dd-4330-bec6-3c8c968ee79c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:44.625756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 352/699] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:44.630803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:44.776386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d97ff-30dd-4330-bec6-3c8c968ee79c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:44.785565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:44.825012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:44.837387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3146181-3f75-4bba-abe1-b57b71cc142c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:44.860462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:44.861070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:44.861351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:44.861649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:44.862302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:44.862607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:44.863972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:44.876914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:44.877594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:44.877881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:44.878156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:44.884648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 348/700] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:44.891337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:44.891823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:44.892913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:44.905078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:44.905982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:44.906845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:44.906845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:44.906845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:44.906845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:44.906845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:44.906845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:44.906845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:44.906845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:44.907691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 353/701] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:44.917479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:45.039236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798159-14d9-4493-8213-5ec8999f62c5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:45.039619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605695c-d978-4cb8-bd15-e296c57f03c7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:45.083718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:45.084352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.084641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.084923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.085663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:45.086077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:45.087803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:45.096112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:45.097960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.098484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.099788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.105247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 354/702] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:45.107316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:45.108247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:45.109727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:45.123707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:45.124584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:45.125485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:45.125485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:45.125485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:45.125485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:45.125485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:45.125485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:45.125485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:45.125485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:45.125913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 349/703] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:45.126520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:45.137359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:45.161783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:45.245198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea22c1c-6075-41a4-bf37-ef7d82a6f148 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:45.268256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775ba1f-e3db-420c-8243-c510edcf5be5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:45.288589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:45.289595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.290058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.290510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.291542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=454105f786874ed1b407da41aef24389, user.id=1b9f7c644bde4c94a8cfe5ec13e782c3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:45.292113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:45.293795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:45.300744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 350/704] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:45 2022] GET /identity/v3/role_assignments?user.id=1b9f7c644bde4c94a8cfe5ec13e782c3&scope.project.id=454105f786874ed1b407da41aef24389&role.id=c182619b007b495f912901d866e751e1 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:45.301944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:45.318921 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:45.319627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.320099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.320380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.325443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:45.325443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:45.336748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:45.338128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:45.339061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 355/705] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Sep 8 01:00:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:45.345213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:45.453866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:45.468721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e592e-7dda-4a44-be05-4502126911d5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:45.475172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:45.504946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db35fde-0009-4149-8c32-1a730f0d48cf None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:45.514481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312da9e-163e-4bf7-b46f-65b99f38c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:45.515535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312da9e-163e-4bf7-b46f-65b99f38c515 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.516025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312da9e-163e-4bf7-b46f-65b99f38c515 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.518256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312da9e-163e-4bf7-b46f-65b99f38c515 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.519022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312da9e-163e-4bf7-b46f-65b99f38c515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:45.519342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312da9e-163e-4bf7-b46f-65b99f38c515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:45.520796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312da9e-163e-4bf7-b46f-65b99f38c515 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:45.537390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 351/706] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:45.540468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760122-cd69-4dc2-85d2-280ee2952deb None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.540993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760122-cd69-4dc2-85d2-280ee2952deb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.541554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760122-cd69-4dc2-85d2-280ee2952deb None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.543265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 352/707] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:45.544202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760122-cd69-4dc2-85d2-280ee2952deb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:45.557938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d063e-7a71-4416-923f-0b1fbbcf6864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:45.558538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d063e-7a71-4416-923f-0b1fbbcf6864 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.558822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d063e-7a71-4416-923f-0b1fbbcf6864 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.559151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d063e-7a71-4416-923f-0b1fbbcf6864 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.559793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d063e-7a71-4416-923f-0b1fbbcf6864 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:45.560098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d063e-7a71-4416-923f-0b1fbbcf6864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:45.561575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d063e-7a71-4416-923f-0b1fbbcf6864 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:45.566652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 356/708] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 8 01:00:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:45.567983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6599-5442-4331-8518-6f9a42c8eb47 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.568270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6599-5442-4331-8518-6f9a42c8eb47 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.568546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb6599-5442-4331-8518-6f9a42c8eb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.588952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fdbb6599-5442-4331-8518-6f9a42c8eb47 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:45.590288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fdbb6599-5442-4331-8518-6f9a42c8eb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:45.663146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760122-cd69-4dc2-85d2-280ee2952deb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:45.685431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 357/709] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:45.685431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb6599-5442-4331-8518-6f9a42c8eb47 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:45.718484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fea55-cc26-41d7-a2e3-55e7b74bebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:45.719097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fea55-cc26-41d7-a2e3-55e7b74bebbd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.719375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fea55-cc26-41d7-a2e3-55e7b74bebbd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.719648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fea55-cc26-41d7-a2e3-55e7b74bebbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.720376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fea55-cc26-41d7-a2e3-55e7b74bebbd None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=3c3d9f448692440fbeee652da473fd05) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:45.720682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fea55-cc26-41d7-a2e3-55e7b74bebbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:45.722149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fea55-cc26-41d7-a2e3-55e7b74bebbd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:45.728558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 353/710] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:45 2022] GET /identity/v3/role_assignments?user.id=3c3d9f448692440fbeee652da473fd05&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:45.729813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d242-1d59-4ef1-ad25-ee5a27d7a33d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.730094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d242-1d59-4ef1-ad25-ee5a27d7a33d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.730364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d242-1d59-4ef1-ad25-ee5a27d7a33d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.736243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 354/711] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:45.737521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29831b-ae88-4b5e-b4d4-8dcd5875ec38 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.737810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29831b-ae88-4b5e-b4d4-8dcd5875ec38 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.738085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29831b-ae88-4b5e-b4d4-8dcd5875ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.783485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:45.786239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ab29831b-ae88-4b5e-b4d4-8dcd5875ec38 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:45.787520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ab29831b-ae88-4b5e-b4d4-8dcd5875ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:45.797133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:45.862608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb6599-5442-4331-8518-6f9a42c8eb47 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:45.908014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:45.909480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:45.909947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:45.910429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:45.911257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:45.911760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:45.913366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:45.916282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 355/712] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:45.928919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 358/713] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 8 01:00:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:46.002433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29831b-ae88-4b5e-b4d4-8dcd5875ec38 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:46.118672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29831b-ae88-4b5e-b4d4-8dcd5875ec38 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:46.160241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:46.160893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:46.161169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:46.161467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] PATH_INFO: `/v3/services/network` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:46.162064 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:46.163430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:46.174685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:46.175780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:46.176980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 356/714] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:46 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:46.181634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:46.211273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:46.225793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:46.310240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ef06-62a1-4451-b17f-292ce5028d76 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:46.321900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddb3f4-cf74-455a-a6ff-6473577a5ebe None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:46.357263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:46.359006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:46.359492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:46.359761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:46.360209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:46.360383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:46.360654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:46.360920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:46.361674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:46.362193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:46.363794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:46.368973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 359/715] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:00:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:46.369745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:46.378127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:46.395117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:46.398433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:46.426819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:46.427850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:46.428771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:46.428771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:46.428771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:46.436550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 357/716] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:46.442429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:46.539421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:46.575542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf495fb2-f34a-4405-9327-20bf134c970f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:46.640333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c737f-50e8-4095-bd3a-9062ad50a6f4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:46.711002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:46.711709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:46.714502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:46.714783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:46.715543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] RBAC: Adding query filter params (type=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:46.715853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:46.717809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:46.723237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 360/717] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:00:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:46.753795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4e685-a399-46d6-a58b-8f57f511871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:46.754856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e685-a399-46d6-a58b-8f57f511871e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:46.755343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e685-a399-46d6-a58b-8f57f511871e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:46.755820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4e685-a399-46d6-a58b-8f57f511871e None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:46.756724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4e685-a399-46d6-a58b-8f57f511871e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:46.757238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4e685-a399-46d6-a58b-8f57f511871e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:46.758892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4e685-a399-46d6-a58b-8f57f511871e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:46.780793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 358/718] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:46.786143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:46.883246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:46.933288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278b2cb-9bc5-4263-98b1-bc45c9777ddc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:46.978988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ec3c1-94ed-4541-baec-6bec789a164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:46.979674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ec3c1-94ed-4541-baec-6bec789a164e None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:46.979951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ec3c1-94ed-4541-baec-6bec789a164e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:46.980223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ec3c1-94ed-4541-baec-6bec789a164e None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:46.980875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ec3c1-94ed-4541-baec-6bec789a164e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:46.982324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ec3c1-94ed-4541-baec-6bec789a164e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:47.011361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 361/719] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:00:46 2022] POST /identity/v3/users => generated 254 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:47.754995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59407-f4c8-4cb8-a81b-397913660a70 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:47.755523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59407-f4c8-4cb8-a81b-397913660a70 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:47.755523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59407-f4c8-4cb8-a81b-397913660a70 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:47.757105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 359/720] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:47.762323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900637fd-5f5a-4e42-b016-6226ce6ee73a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:47.762834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900637fd-5f5a-4e42-b016-6226ce6ee73a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:47.763587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900637fd-5f5a-4e42-b016-6226ce6ee73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:47.784881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-900637fd-5f5a-4e42-b016-6226ce6ee73a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:47.786379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-900637fd-5f5a-4e42-b016-6226ce6ee73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:47.868063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 362/721] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:48.212322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59407-f4c8-4cb8-a81b-397913660a70 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:48.342757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59407-f4c8-4cb8-a81b-397913660a70 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:48.367142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:48.390782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df44b7-48e6-43c4-bbd9-f190ff4dcce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:48.391418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df44b7-48e6-43c4-bbd9-f190ff4dcce2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:48.391695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df44b7-48e6-43c4-bbd9-f190ff4dcce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:48.391962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df44b7-48e6-43c4-bbd9-f190ff4dcce2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:48.407388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df44b7-48e6-43c4-bbd9-f190ff4dcce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-48df44b7-48e6-43c4-bbd9-f190ff4dcce2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:48.412456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:48.413432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:48.414968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 360/722] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:48.419360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900637fd-5f5a-4e42-b016-6226ce6ee73a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:48.478979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:48.569443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900637fd-5f5a-4e42-b016-6226ce6ee73a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:48.620089 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:48.620765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:48.621055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:48.621332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:48.622056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:48.622366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:48.624930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00f8e-c380-4423-8a0f-53a4c9a2072c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:48.625233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00f8e-c380-4423-8a0f-53a4c9a2072c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:48.625504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00f8e-c380-4423-8a0f-53a4c9a2072c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:48.627139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 361/723] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:48.628210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:48.636159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97773-bdb4-4cbe-b531-4ff328c676e5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:48.636159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97773-bdb4-4cbe-b531-4ff328c676e5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:48.636159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97773-bdb4-4cbe-b531-4ff328c676e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:48.650055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 363/724] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:48.653830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:48.670326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-44a97773-bdb4-4cbe-b531-4ff328c676e5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:48.671537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44a97773-bdb4-4cbe-b531-4ff328c676e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:48.800935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 362/725] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:48.824161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8d93a-9174-4366-a6b4-04864b4c9db2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:48.835795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:48.862224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456d9c9-0fd3-4fc8-a7da-6cf4bb8f0aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:48.862866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d9c9-0fd3-4fc8-a7da-6cf4bb8f0aff None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:48.863149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d9c9-0fd3-4fc8-a7da-6cf4bb8f0aff None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:48.863428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d9c9-0fd3-4fc8-a7da-6cf4bb8f0aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:48.874624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456d9c9-0fd3-4fc8-a7da-6cf4bb8f0aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:48.876149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456d9c9-0fd3-4fc8-a7da-6cf4bb8f0aff None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c456d9c9-0fd3-4fc8-a7da-6cf4bb8f0aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:48.892159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:48.893740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:48.895147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:48.895147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:48.895147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:48.899054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a97773-bdb4-4cbe-b531-4ff328c676e5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:48.901601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 364/726] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:49.038621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a97773-bdb4-4cbe-b531-4ff328c676e5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:49.051240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:49.057891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2570d7-0a17-4f31-a0c9-f12f1e3d5d9f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.058175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2570d7-0a17-4f31-a0c9-f12f1e3d5d9f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.058513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2570d7-0a17-4f31-a0c9-f12f1e3d5d9f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.060125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 365/727] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:00:49.065890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b709a-f9f2-47f3-8bc6-b48993d6105f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.066177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b709a-f9f2-47f3-8bc6-b48993d6105f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.066456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b709a-f9f2-47f3-8bc6-b48993d6105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.085115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f94b709a-f9f2-47f3-8bc6-b48993d6105f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:49.086566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f94b709a-f9f2-47f3-8bc6-b48993d6105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:49.087970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:49.088582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.088869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.089145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.089816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:49.090123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:49.091483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:49.111745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 363/728] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:49.118473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:49.171469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 366/729] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 01:00:49.244275 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b709a-f9f2-47f3-8bc6-b48993d6105f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:49.289986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd357d7-58df-4195-beb2-ad3745880b46 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:49.332201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637b1bb-df30-4256-a90f-164d766e414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:49.332756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b1bb-df30-4256-a90f-164d766e414c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.333047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b1bb-df30-4256-a90f-164d766e414c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.333329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b1bb-df30-4256-a90f-164d766e414c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.341933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637b1bb-df30-4256-a90f-164d766e414c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:49.344261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637b1bb-df30-4256-a90f-164d766e414c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0637b1bb-df30-4256-a90f-164d766e414c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:49.356870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:49.358397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:49.359323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 364/730] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:00:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:49.360806 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b580f-e5b1-40c0-9633-b6eaa96590f6 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.361780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b580f-e5b1-40c0-9633-b6eaa96590f6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.361780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b580f-e5b1-40c0-9633-b6eaa96590f6 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.365308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 365/731] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:49.367518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b580f-e5b1-40c0-9633-b6eaa96590f6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:49.373202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:49.384364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b709a-f9f2-47f3-8bc6-b48993d6105f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:49.402583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:49.424342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94683cfc-f1a4-4c34-b0ae-de7551fb5d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:49.425695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683cfc-f1a4-4c34-b0ae-de7551fb5d62 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.426194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683cfc-f1a4-4c34-b0ae-de7551fb5d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.426606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683cfc-f1a4-4c34-b0ae-de7551fb5d62 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.428718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683cfc-f1a4-4c34-b0ae-de7551fb5d62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:49.430353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683cfc-f1a4-4c34-b0ae-de7551fb5d62 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:49.456071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 367/732] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:00:49 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:49.457872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af190f1-d7bf-4bee-b567-b3874c89b7cb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.458374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af190f1-d7bf-4bee-b567-b3874c89b7cb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.458885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af190f1-d7bf-4bee-b567-b3874c89b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.494030 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6af190f1-d7bf-4bee-b567-b3874c89b7cb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:49.495601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6af190f1-d7bf-4bee-b567-b3874c89b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:49.502030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b580f-e5b1-40c0-9633-b6eaa96590f6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:49.550984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:49.551650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.552483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.552791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.553615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:49.553928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:49.556228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:49.585339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 366/733] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:00:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:49.585339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:49.588052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 368/734] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 01:00:49.589167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af190f1-d7bf-4bee-b567-b3874c89b7cb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:49.719525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:49.721690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:49.743943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcef0-170f-43d8-91f1-940a3aa61770 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:49.746253 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af190f1-d7bf-4bee-b567-b3874c89b7cb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:49.783018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b7ad5-1d0d-47cd-a408-0107cbfa8e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:49.783810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b7ad5-1d0d-47cd-a408-0107cbfa8e18 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.784102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b7ad5-1d0d-47cd-a408-0107cbfa8e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.784380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b7ad5-1d0d-47cd-a408-0107cbfa8e18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.790668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:49.791303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.791583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.791857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.797220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b7ad5-1d0d-47cd-a408-0107cbfa8e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ef0b7ad5-1d0d-47cd-a408-0107cbfa8e18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:49.802144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:49.803430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:49.804235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:49.804840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:49.804910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 367/735] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:49.804974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:49.814892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b7ad5-1d0d-47cd-a408-0107cbfa8e18 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:49.826771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:49.827693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:49.828625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:49.828625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:49.828625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:49.828625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 369/736] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:49.835038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:49.930149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b7ad5-1d0d-47cd-a408-0107cbfa8e18 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:49.962740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c2e6-98f8-462c-a338-f1e6d2e9291b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:49.977095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:49.977764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:49.978047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:49.978669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:49.979683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:49.979997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:49.981450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:49.993501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 368/737] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:49.994532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.016892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:50.017566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:50.017966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.018699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.019053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.019833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:50.020180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:50.021708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:50.023587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:50.046055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 370/738] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:50.046055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.119372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b11aa5-31b2-4ed5-b916-35336df3f7a2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:50.156554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716c61-e437-4b4d-bd46-31ecd43d0650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:50.157159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716c61-e437-4b4d-bd46-31ecd43d0650 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.157453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716c61-e437-4b4d-bd46-31ecd43d0650 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.157904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d716c61-e437-4b4d-bd46-31ecd43d0650 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.158561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d716c61-e437-4b4d-bd46-31ecd43d0650 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:50.158825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb95e5-8579-4c48-b3f1-f46449292f3f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:50.159921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d716c61-e437-4b4d-bd46-31ecd43d0650 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:50.181531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 369/739] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:00:49 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:50.181531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716c61-e437-4b4d-bd46-31ecd43d0650 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.211801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185da48-b4a2-4abb-9d52-a2a2a9a2a22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:50.212502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185da48-b4a2-4abb-9d52-a2a2a9a2a22b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.212780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185da48-b4a2-4abb-9d52-a2a2a9a2a22b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.213047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185da48-b4a2-4abb-9d52-a2a2a9a2a22b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.227919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185da48-b4a2-4abb-9d52-a2a2a9a2a22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:50.229395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185da48-b4a2-4abb-9d52-a2a2a9a2a22b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8185da48-b4a2-4abb-9d52-a2a2a9a2a22b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:50.251760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:50.252821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:50.254311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:50.254311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:50.254311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:50.257990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 371/740] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:50.259210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b18f-5388-49e0-a81a-948ce085fb75 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.259511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b18f-5388-49e0-a81a-948ce085fb75 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.259788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b18f-5388-49e0-a81a-948ce085fb75 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.266269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 372/741] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:50.266269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8b18f-5388-49e0-a81a-948ce085fb75 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.293540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:50.320457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:50.348481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d716c61-e437-4b4d-bd46-31ecd43d0650 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:50.394828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3059472-187d-4f20-9f47-f4cab2a6ea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:50.395462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059472-187d-4f20-9f47-f4cab2a6ea04 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.395739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059472-187d-4f20-9f47-f4cab2a6ea04 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.396012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3059472-187d-4f20-9f47-f4cab2a6ea04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.404910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8b18f-5388-49e0-a81a-948ce085fb75 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:50.406129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3059472-187d-4f20-9f47-f4cab2a6ea04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:50.407573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3059472-187d-4f20-9f47-f4cab2a6ea04 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f3059472-187d-4f20-9f47-f4cab2a6ea04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:50.420974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:50.422014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:50.422954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 370/742] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:50.423445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d5795-9842-4696-8bcb-f95c5f987bc9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.423512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d5795-9842-4696-8bcb-f95c5f987bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.424025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d5795-9842-4696-8bcb-f95c5f987bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.443429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:50.444149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.444545 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.444883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.445686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:50.446036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:50.447695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:50.450885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d99d5795-9842-4696-8bcb-f95c5f987bc9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:50.452366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d99d5795-9842-4696-8bcb-f95c5f987bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:50.460686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 373/743] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:50.465627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.545464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 371/744] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:00:50.545464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d5795-9842-4696-8bcb-f95c5f987bc9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.606747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445814b-0b84-4c93-8911-721e6318ce1d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:50.609851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:50.619923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:50.675154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:50.675759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.676034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.676305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.676986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:50.677282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:50.678719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:50.702515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 374/745] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:50.704330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d5795-9842-4696-8bcb-f95c5f987bc9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:50.708162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.779829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:50.780828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.781365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.781993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.798098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:50.800829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:50.826703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:50.828100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:50.829010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:50.831536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 372/746] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:50.838762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.891761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8a778-774f-4a7d-acfc-1da4ba00ae49 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:50.938804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782231f-4d40-439e-a6c4-80e76fb2a844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:50.939762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782231f-4d40-439e-a6c4-80e76fb2a844 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:50.940053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782231f-4d40-439e-a6c4-80e76fb2a844 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:50.940331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782231f-4d40-439e-a6c4-80e76fb2a844 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/1b9f7c644bde4c94a8cfe5ec13e782c3/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:50.942523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782231f-4d40-439e-a6c4-80e76fb2a844 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=1b9f7c644bde4c94a8cfe5ec13e782c3, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:50.944779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782231f-4d40-439e-a6c4-80e76fb2a844 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:50.964400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 375/747] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:00:50 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/1b9f7c644bde4c94a8cfe5ec13e782c3/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:00:50.964835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d2ab-7b6e-4290-ad3b-73ee7920e8b8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:50.965424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782231f-4d40-439e-a6c4-80e76fb2a844 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:50.981443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:50.995832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:51.010107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:51.011135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:51.011624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:51.012190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:51.013173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:51.014639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:51.016364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:51.039408 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 373/748] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 8 01:00:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:51.046916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:51.125341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782231f-4d40-439e-a6c4-80e76fb2a844 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:51.189946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b8c6-4fde-45d7-9e08-2b0980b982be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:51.190727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b8c6-4fde-45d7-9e08-2b0980b982be None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:51.191007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b8c6-4fde-45d7-9e08-2b0980b982be None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:51.191280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b8c6-4fde-45d7-9e08-2b0980b982be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:51.206950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b8c6-4fde-45d7-9e08-2b0980b982be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b802b8c6-4fde-45d7-9e08-2b0980b982be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:51.212828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:51.213824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:51.215095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 376/749] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:51.220684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b8c6-4fde-45d7-9e08-2b0980b982be None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:51.233149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b2b4-3a9c-41be-83fe-c27105dc91cb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:51.291051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff953b5-a48d-4294-9da9-614696abea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:51.292373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff953b5-a48d-4294-9da9-614696abea05 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:51.292661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff953b5-a48d-4294-9da9-614696abea05 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:51.292937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff953b5-a48d-4294-9da9-614696abea05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:51.329105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:51.340761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:51.366221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b8c6-4fde-45d7-9e08-2b0980b982be None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:51.390475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff953b5-a48d-4294-9da9-614696abea05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:51.391996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff953b5-a48d-4294-9da9-614696abea05 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:51.431324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:51.432245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:51.432529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:51.432798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:51.433488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:51.433796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:51.435170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:51.453505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 377/750] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:51.461216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:51.588714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 374/751] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:00:51.594434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff953b5-a48d-4294-9da9-614696abea05 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:51.639078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69091f2c-8bf1-4747-a592-a9055175f79a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:51.675445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:51.676154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:51.676443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:51.676719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:51.688694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:51.690208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:51.699037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:51.706987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:51.708229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:51.709805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:51.709805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:51.709805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:51.709805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 378/752] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:51.714255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:51.786606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:51.826890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db437e6d-eb5d-4c23-b8a7-df72c8bda476 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:51.855551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff953b5-a48d-4294-9da9-614696abea05 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:51.864243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:51.864907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:51.865184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:51.865523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:51.866290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:51.866602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:51.868153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:51.881596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 379/753] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:51.890351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:51.931978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:51.932674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:51.932953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:51.933224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:51.953117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:51.954619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:51.986812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:51.989019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:51.991117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:51.991117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:51.991117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:51.991117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 375/754] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:51.995617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:52.008858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:52.113845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad89d0-a206-4761-9865-1cabedf158d1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:52.132735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648d17-1ce9-41fe-9877-c925f2e0feac None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:52.140108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:52.152194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34607041-d569-489e-8a26-9ab0a25b97af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:52.153112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607041-d569-489e-8a26-9ab0a25b97af None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.153633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607041-d569-489e-8a26-9ab0a25b97af None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.154661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34607041-d569-489e-8a26-9ab0a25b97af None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.155529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607041-d569-489e-8a26-9ab0a25b97af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:52.156052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607041-d569-489e-8a26-9ab0a25b97af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:52.157636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34607041-d569-489e-8a26-9ab0a25b97af None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:52.170469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 376/755] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:52.171889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143abb5-cb66-401d-9792-ae2da84ebbf9 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.172288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143abb5-cb66-401d-9792-ae2da84ebbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.172658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143abb5-cb66-401d-9792-ae2da84ebbf9 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.173818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fac092-8a84-491d-b1a4-f767bbca067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:52.174376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 377/756] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:52.174763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fac092-8a84-491d-b1a4-f767bbca067f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.175212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fac092-8a84-491d-b1a4-f767bbca067f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.175673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fac092-8a84-491d-b1a4-f767bbca067f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.176045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143abb5-cb66-401d-9792-ae2da84ebbf9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:52.184994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fac092-8a84-491d-b1a4-f767bbca067f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:52.187281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fac092-8a84-491d-b1a4-f767bbca067f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a2fac092-8a84-491d-b1a4-f767bbca067f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:52.203779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:52.204797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:00:52.206243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:52.209718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 380/757] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:00:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:52.211106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f67c0c-1931-4b2f-a54a-98b25330dac9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.211606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f67c0c-1931-4b2f-a54a-98b25330dac9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.212071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f67c0c-1931-4b2f-a54a-98b25330dac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.236068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-55f67c0c-1931-4b2f-a54a-98b25330dac9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:52.238236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-55f67c0c-1931-4b2f-a54a-98b25330dac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:52.291754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143abb5-cb66-401d-9792-ae2da84ebbf9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:52.328261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 381/758] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:00:52.329120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f67c0c-1931-4b2f-a54a-98b25330dac9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:52.354685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:52.355341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.355628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.355903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.378172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:52.379559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:52.381566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:52.407039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:52.408159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:52.409267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 378/759] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:52.418203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:52.445906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f67c0c-1931-4b2f-a54a-98b25330dac9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:52.485724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:52.487060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.487491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.487914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.488847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:52.489326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:52.491590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:52.513134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 382/760] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 8 01:00:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:52.522276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:52.549770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:52.617088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320352c-33e7-416c-9ad7-c5baa877953e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:52.657303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3888-840e-41a2-a46f-ca0b33436136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:52.657943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3888-840e-41a2-a46f-ca0b33436136 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.658224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3888-840e-41a2-a46f-ca0b33436136 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.658497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3888-840e-41a2-a46f-ca0b33436136 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.659188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a3888-840e-41a2-a46f-ca0b33436136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:52.659491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a3888-840e-41a2-a46f-ca0b33436136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:52.660929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a3888-840e-41a2-a46f-ca0b33436136 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:52.673460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 379/761] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:52.674741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beea944-7c35-4a1f-bd70-61b461ad3cf0 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.675030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beea944-7c35-4a1f-bd70-61b461ad3cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.675367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beea944-7c35-4a1f-bd70-61b461ad3cf0 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.680690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 380/762] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:52.681489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beea944-7c35-4a1f-bd70-61b461ad3cf0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:52.688945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66878a63-4fe3-4e40-a35c-1066d93ae39b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:52.691846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:52.729382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeee527-f722-4c64-8457-4c0fd655adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:52.730045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee527-f722-4c64-8457-4c0fd655adea None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.730327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee527-f722-4c64-8457-4c0fd655adea None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.730601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeee527-f722-4c64-8457-4c0fd655adea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.797676 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beea944-7c35-4a1f-bd70-61b461ad3cf0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:52.801132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:52.801702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeee527-f722-4c64-8457-4c0fd655adea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:52.803154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeee527-f722-4c64-8457-4c0fd655adea None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:52.836628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04a073-7872-420b-9d63-54bf1653b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:52.837235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a073-7872-420b-9d63-54bf1653b2bf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.837551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a073-7872-420b-9d63-54bf1653b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.837832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a073-7872-420b-9d63-54bf1653b2bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.838567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04a073-7872-420b-9d63-54bf1653b2bf None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=454105f786874ed1b407da41aef24389, user.id=3c3d9f448692440fbeee652da473fd05) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:52.838885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04a073-7872-420b-9d63-54bf1653b2bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:52.840295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04a073-7872-420b-9d63-54bf1653b2bf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:52.853788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 381/763] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:52 2022] GET /identity/v3/role_assignments?user.id=3c3d9f448692440fbeee652da473fd05&scope.project.id=454105f786874ed1b407da41aef24389&role.id=c182619b007b495f912901d866e751e1 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:52.855636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa441-37bc-413c-94c9-6540c2be46a5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:52.856219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa441-37bc-413c-94c9-6540c2be46a5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:52.856297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfa441-37bc-413c-94c9-6540c2be46a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:52.884379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3abfa441-37bc-413c-94c9-6540c2be46a5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:52.886874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3abfa441-37bc-413c-94c9-6540c2be46a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:52.923217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 383/764] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:00:52.924408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeee527-f722-4c64-8457-4c0fd655adea None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:52.929388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:52.988740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 382/765] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:00:52.990002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfa441-37bc-413c-94c9-6540c2be46a5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.046834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeee527-f722-4c64-8457-4c0fd655adea None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.096234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.096880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.097162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.097456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.098049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.099428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.112825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:53.117207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:53.118473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:53.119533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:53.120301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 384/766] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Sep 8 01:00:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:53.127742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfa441-37bc-413c-94c9-6540c2be46a5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.128381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.194999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.195997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.196484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.197008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.222501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.223955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.235125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:53.255273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:53.256309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:53.257266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:53.257266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:53.257266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:53.265733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 383/767] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:53.266623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.274461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371612-63a2-4f97-8e92-6d06260b3af6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.312324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.313348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.314011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.314557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.315664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:53.316208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.317826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.324378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 385/768] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:53.330882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.432114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e5637-241b-4b7b-b1f4-294da6366a66 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.447704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542673-23dc-4c71-98dd-bd476a311bff None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.480331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.481676 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.482600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.483396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:53.483707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.485128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:53.485744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.487891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.489276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.490662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.490941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.491277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.491911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:53.492212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.493629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.504123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 386/769] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:53.504123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.518828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 384/770] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:53.519758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.534310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:53.628294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1382a2-92a5-4d84-be0a-fa01c5691521 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.630497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e792-a384-4464-b7e1-b333f28619eb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.667733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.668364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.668797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.669386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] PATH_INFO: `/v3/services/network` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.670024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.671392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.674436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43f724-abae-4992-bfc6-ceea2a5c34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.675062 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f724-abae-4992-bfc6-ceea2a5c34e9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.675342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f724-abae-4992-bfc6-ceea2a5c34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.675615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f724-abae-4992-bfc6-ceea2a5c34e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.676325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f724-abae-4992-bfc6-ceea2a5c34e9 None admin] RBAC: Adding query filter params (interface=public, service_id=6eec86d0bb864a228d440cd4f45952b3, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:53.676641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f724-abae-4992-bfc6-ceea2a5c34e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.678025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f724-abae-4992-bfc6-ceea2a5c34e9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:53.681228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:53.682389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:53.683499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 387/771] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:53.686187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.696864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 385/772] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/endpoints?service_id=6eec86d0bb864a228d440cd4f45952b3&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:53.696864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba465c9-794f-42a6-84cd-98f5cb8fe867 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.696864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba465c9-794f-42a6-84cd-98f5cb8fe867 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.696864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba465c9-794f-42a6-84cd-98f5cb8fe867 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.696864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 386/773] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:53.696864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba465c9-794f-42a6-84cd-98f5cb8fe867 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.751565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:53.780587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:53.793523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531733-d180-4496-a834-1b9cb1c41c92 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.809648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba465c9-794f-42a6-84cd-98f5cb8fe867 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:53.833271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.833968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.834243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.834514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.844066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.845621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.849358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bc995-837e-4e20-9a4b-eac486ebcc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:53.850114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bc995-837e-4e20-9a4b-eac486ebcc94 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.850515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bc995-837e-4e20-9a4b-eac486ebcc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.850985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bc995-837e-4e20-9a4b-eac486ebcc94 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.851718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bc995-837e-4e20-9a4b-eac486ebcc94 None admin] RBAC: Adding query filter params (name=network) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:53.852120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bc995-837e-4e20-9a4b-eac486ebcc94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:53.853598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bc995-837e-4e20-9a4b-eac486ebcc94 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:53.857849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:53.858854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:53.868835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 388/774] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:53.869471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 387/775] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:53.869979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.870058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564b8c1-5669-4a1a-a557-f89b77d9e7ce None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:53.870058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564b8c1-5669-4a1a-a557-f89b77d9e7ce None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:53.870058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564b8c1-5669-4a1a-a557-f89b77d9e7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:53.886239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8564b8c1-5669-4a1a-a557-f89b77d9e7ce None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:53.887451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8564b8c1-5669-4a1a-a557-f89b77d9e7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:53.954348 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 388/776] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:00:53.955169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564b8c1-5669-4a1a-a557-f89b77d9e7ce None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:53.988973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a839ac3-8b3b-40c1-8d8f-52b6745f44d4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:54.011015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:54.032018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f9838-7b4c-44f9-8ee2-0218397dfb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:54.033102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f9838-7b4c-44f9-8ee2-0218397dfb0f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:54.033385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f9838-7b4c-44f9-8ee2-0218397dfb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:54.033684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f9838-7b4c-44f9-8ee2-0218397dfb0f None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:54.034593 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f9838-7b4c-44f9-8ee2-0218397dfb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:54.036244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f9838-7b4c-44f9-8ee2-0218397dfb0f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:54.042823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 389/777] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:54.043866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f9838-7b4c-44f9-8ee2-0218397dfb0f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:54.045798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:54.092865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564b8c1-5669-4a1a-a557-f89b77d9e7ce None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:54.134926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:54.136015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:54.136495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:54.136994 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:54.137956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:54.138814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:54.140463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:54.155841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 389/778] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:54.162678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:54.253889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f9838-7b4c-44f9-8ee2-0218397dfb0f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:54.308701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:54.309236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:54.309552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:54.309825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:54.310454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] RBAC: Adding query filter params (type=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:54.310756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:54.312114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:54.323559 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 390/779] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:00:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:54.324437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:54.344609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971f8a6-2221-4f18-b371-bdfd8f8ba7f2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:54.374597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:54.384730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:54.386931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:54.387991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:54.388807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:54.390195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:54.391117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=912d86eef7b64c0a8b260ae7a804991d) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:54.391647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:54.394092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:54.401507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 390/780] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:54 2022] GET /identity/v3/role_assignments?user.id=912d86eef7b64c0a8b260ae7a804991d&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:54.402524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:54.452909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfae004-ec2d-4a90-b96f-25a77554a05b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:54.523418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0ce0-9d6b-4867-a4a3-e271bbef53ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:54.524835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0ce0-9d6b-4867-a4a3-e271bbef53ae None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:54.525294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0ce0-9d6b-4867-a4a3-e271bbef53ae None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:54.525768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0ce0-9d6b-4867-a4a3-e271bbef53ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:54.552982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b0ce0-9d6b-4867-a4a3-e271bbef53ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-dc1b0ce0-9d6b-4867-a4a3-e271bbef53ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:54.565966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:54.567497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:54.568502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:54.578419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 391/781] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:54.587339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e8079-6979-412c-a89f-e6d7a53c909a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:54.596446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0ce0-9d6b-4867-a4a3-e271bbef53ae None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:54.676212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:54.676836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:54.677126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:54.677381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:54.678112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] RBAC: Adding query filter params (interface=public, service_id=9d72ae0bfa11496985831b67408dc232, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:54.678416 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:54.679780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:54.693094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 391/782] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 8 01:00:54 2022] GET /identity/v3/endpoints?service_id=9d72ae0bfa11496985831b67408dc232&interface=public®ion_id=RegionOne => generated 194 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:54.699799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:54.810088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0ce0-9d6b-4867-a4a3-e271bbef53ae None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:54.812946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:54.827743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:54.885087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:54.886112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:54.887094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13ee1-ea31-46d0-a6a9-b0a8ef77c93b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:54.887901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:54.889911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:54.890781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:54.891279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:54.892849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:54.914592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 392/783] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:54.916169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:54.958534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9608801-40b7-4ef2-8dfb-e3801d59cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:54.959515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9608801-40b7-4ef2-8dfb-e3801d59cea1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:54.960000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9608801-40b7-4ef2-8dfb-e3801d59cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:54.960465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9608801-40b7-4ef2-8dfb-e3801d59cea1 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:54.961383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9608801-40b7-4ef2-8dfb-e3801d59cea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:54.962973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9608801-40b7-4ef2-8dfb-e3801d59cea1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:54.978555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 392/784] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:00:54 2022] GET /identity/v3/services => generated 772 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:55.084040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5218d-bbb9-4629-85aa-bbf2ddde66c6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:55.139345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:55.140409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:55.140896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:55.141362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:55.154658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:55.156469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:55.183352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:55.184336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:55.185208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:55.185208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:55.185208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:55.187887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 393/785] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:55.195180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9608801-40b7-4ef2-8dfb-e3801d59cea1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:55.310341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9608801-40b7-4ef2-8dfb-e3801d59cea1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:55.333134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:55.351518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb983824-a07e-4971-901c-f56405838f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:55.352059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb983824-a07e-4971-901c-f56405838f03 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:55.352336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb983824-a07e-4971-901c-f56405838f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:55.352608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb983824-a07e-4971-901c-f56405838f03 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:55.353279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb983824-a07e-4971-901c-f56405838f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:55.353618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb983824-a07e-4971-901c-f56405838f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:55.355120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb983824-a07e-4971-901c-f56405838f03 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:55.374979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 393/786] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:55.380591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:55.395808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b931ae-1b2d-4552-86ad-25b02ebe794e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:55.395808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b931ae-1b2d-4552-86ad-25b02ebe794e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:55.395808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b931ae-1b2d-4552-86ad-25b02ebe794e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:55.396432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 394/787] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:00:55.402248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc421-456a-4535-9eae-7c4f39ef000d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:55.402781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc421-456a-4535-9eae-7c4f39ef000d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:55.403261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cc421-456a-4535-9eae-7c4f39ef000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:55.420530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:55.423729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-186cc421-456a-4535-9eae-7c4f39ef000d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:55.424939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-186cc421-456a-4535-9eae-7c4f39ef000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:55.500068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 395/788] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:00:55.576641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daf596-52b9-452f-8b10-3d4991c10508 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:55.619082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:55.619638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:55.619915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:55.620183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:55.630264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:55.631708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:55.646890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:55.647854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:55.648785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 394/789] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:00:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:55.653583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cc421-456a-4535-9eae-7c4f39ef000d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:55.776603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cc421-456a-4535-9eae-7c4f39ef000d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:55.788182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:55.814068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:55.814680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:55.814958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:55.815234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:55.815964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:55.816274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:55.817719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:55.835447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 396/790] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:00:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:55.840618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:55.895250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:55.969752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:56.003470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eec42-0145-4782-9feb-85e12544ed2f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:56.047730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8e5c9-a0fe-4eec-b629-40858bc6991e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:56.074667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a1dff-664f-492a-9ef7-d0c110fbb274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:56.075624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1dff-664f-492a-9ef7-d0c110fbb274 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.076670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1dff-664f-492a-9ef7-d0c110fbb274 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.077144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1dff-664f-492a-9ef7-d0c110fbb274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.083831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe76f7-1fe3-4835-9b4b-3680e4828ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:56.084462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe76f7-1fe3-4835-9b4b-3680e4828ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.084739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe76f7-1fe3-4835-9b4b-3680e4828ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.085007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe76f7-1fe3-4835-9b4b-3680e4828ba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.097467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe76f7-1fe3-4835-9b4b-3680e4828ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-edfe76f7-1fe3-4835-9b4b-3680e4828ba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:56.101037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:56.101990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:56.102813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 397/791] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:56.109069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe76f7-1fe3-4835-9b4b-3680e4828ba4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:56.140169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:56.211116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a1dff-664f-492a-9ef7-d0c110fbb274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:56.213085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a1dff-664f-492a-9ef7-d0c110fbb274 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:56.217118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe76f7-1fe3-4835-9b4b-3680e4828ba4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:56.254588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:56.255305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.255593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.255870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.256544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:56.256852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:56.258377 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:56.268279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 398/792] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:56.279388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:56.366773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:56.404842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 395/793] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:00:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:00:56.410383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a1dff-664f-492a-9ef7-d0c110fbb274 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:56.483613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:56.489516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49211609-fe18-4f91-bc8d-4f9d88150c57 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:56.528575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:56.529816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.530208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.530486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.543023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:56.544520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:56.561560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:56.562595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:56.563455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:56.563455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:56.563455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:56.563455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 399/794] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:00:56.571197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:56.625661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a1dff-664f-492a-9ef7-d0c110fbb274 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:56.679935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637766-f794-4372-bd6a-94553fd9decb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:56.680591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637766-f794-4372-bd6a-94553fd9decb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.680872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637766-f794-4372-bd6a-94553fd9decb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.681144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637766-f794-4372-bd6a-94553fd9decb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.693721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d637766-f794-4372-bd6a-94553fd9decb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:56.695354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d637766-f794-4372-bd6a-94553fd9decb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5d637766-f794-4372-bd6a-94553fd9decb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:56.712357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:56.713334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:56.714247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:56.714247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:56.714247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:56.714247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 396/795] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:56.717433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9139ea-763f-448f-8666-ee9f5d161bdc None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.717433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9139ea-763f-448f-8666-ee9f5d161bdc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.717433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9139ea-763f-448f-8666-ee9f5d161bdc None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.717773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 397/796] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:56.719676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9139ea-763f-448f-8666-ee9f5d161bdc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:56.732589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6de6-6d30-4fcf-8616-b88c6c2bbf68 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:56.758047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:56.776317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a7aa8-010f-4b09-a785-9b4d83ec8dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:56.777245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a7aa8-010f-4b09-a785-9b4d83ec8dae None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.777701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a7aa8-010f-4b09-a785-9b4d83ec8dae None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.778185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a7aa8-010f-4b09-a785-9b4d83ec8dae None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.779016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a7aa8-010f-4b09-a785-9b4d83ec8dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:56.779627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a7aa8-010f-4b09-a785-9b4d83ec8dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:56.781236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a7aa8-010f-4b09-a785-9b4d83ec8dae None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:56.796110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 400/797] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:56.797813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985fd8-c134-4fc9-b63e-c685cf79e086 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.798458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985fd8-c134-4fc9-b63e-c685cf79e086 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.798738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985fd8-c134-4fc9-b63e-c685cf79e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.806043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:56.821266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8c985fd8-c134-4fc9-b63e-c685cf79e086 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:56.823020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8c985fd8-c134-4fc9-b63e-c685cf79e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:56.836091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9139ea-763f-448f-8666-ee9f5d161bdc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:56.871791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9cb9f-c316-4e03-9167-a40250489b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:56.872405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9cb9f-c316-4e03-9167-a40250489b72 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.872693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9cb9f-c316-4e03-9167-a40250489b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.872998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9cb9f-c316-4e03-9167-a40250489b72 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.873683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9cb9f-c316-4e03-9167-a40250489b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:56.873979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9cb9f-c316-4e03-9167-a40250489b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:56.875338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9cb9f-c316-4e03-9167-a40250489b72 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:56.887561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 398/798] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:56.889680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1aabf-2388-4b27-9f70-d494180711a0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:56.889964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1aabf-2388-4b27-9f70-d494180711a0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:56.890239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1aabf-2388-4b27-9f70-d494180711a0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:56.893436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 399/799] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:56.893436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1aabf-2388-4b27-9f70-d494180711a0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:56.905993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 401/800] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:00:56.914446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c985fd8-c134-4fc9-b63e-c685cf79e086 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.005001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:57.017620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1aabf-2388-4b27-9f70-d494180711a0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.037148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c985fd8-c134-4fc9-b63e-c685cf79e086 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.054327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a62e84-39d9-4b4a-bcb8-5933df749f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.055260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62e84-39d9-4b4a-bcb8-5933df749f5b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.055766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62e84-39d9-4b4a-bcb8-5933df749f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.056270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62e84-39d9-4b4a-bcb8-5933df749f5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.063735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a62e84-39d9-4b4a-bcb8-5933df749f5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.065531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a62e84-39d9-4b4a-bcb8-5933df749f5b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.067539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:57.074225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.074919 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.075198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.075473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e3a62e84-39d9-4b4a-bcb8-5933df749f5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:57.080044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:57.081009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:00:57.081995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:57.083282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.084680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 400/801] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:00:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:57.086208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3a0c-87d0-4593-bb6a-b7d533ac8dce None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.086687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3a0c-87d0-4593-bb6a-b7d533ac8dce None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.087173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3a0c-87d0-4593-bb6a-b7d533ac8dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.089207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:57.101836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:57.102752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 402/802] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:57.104204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.110911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-99fe3a0c-87d0-4593-bb6a-b7d533ac8dce None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:57.112354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-99fe3a0c-87d0-4593-bb6a-b7d533ac8dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:57.192383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 401/803] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:00:57.193625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3a0c-87d0-4593-bb6a-b7d533ac8dce None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.219830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc598b14-9d95-4f14-856c-34194ab9bc3b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.257651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.258268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.258553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.259012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.260140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:57.260457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.262215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.285334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 403/804] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:57.286228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.314953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:57.342378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3a0c-87d0-4593-bb6a-b7d533ac8dce None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.348085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:57.391655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.392559 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.392992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.393441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.394837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:57.395319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.397432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.408540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2bc8d-6b92-4fdd-ad8b-7327b101eaef None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.414485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 402/805] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:57.415518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.450751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.451457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.451927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.452191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.452785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.454862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:57.467003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:57.468131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 01:00:57.468941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:57.473005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 404/806] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:57.473740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.548894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30921-a203-447c-bbdd-0f4ffaa92421 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.584784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.585466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.585752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.586027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.586129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5b47c-57bd-4146-b46c-e32aa2136edb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.598405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.599883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.602582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:57.603665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:57.619997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:57.621016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:57.622296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:57.622296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:57.622296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:00:57.622296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 403/807] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:57.622296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.633530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.634974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.635462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.636359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.637609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=454105f786874ed1b407da41aef24389, user.id=1b9f7c644bde4c94a8cfe5ec13e782c3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:57.638127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.641499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.650427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 405/808] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/role_assignments?user.id=1b9f7c644bde4c94a8cfe5ec13e782c3&scope.project.id=454105f786874ed1b407da41aef24389&role.id=c182619b007b495f912901d866e751e1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:57.651726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.746837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8458700-760c-435e-b6a6-f81dde968605 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.785117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.785424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558c1c4-cb94-456b-b265-aa5dbd2a1a7e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.786181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.786645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.787084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.787733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:57.788031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.789459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.799735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 404/809] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:57.799735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.830530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15f45f-697b-426b-9082-dc0c57e25901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.831180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f45f-697b-426b-9082-dc0c57e25901 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.831461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f45f-697b-426b-9082-dc0c57e25901 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.831737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15f45f-697b-426b-9082-dc0c57e25901 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.843761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15f45f-697b-426b-9082-dc0c57e25901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8f15f45f-697b-426b-9082-dc0c57e25901 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:00:57.848982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:57.850132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:57.850957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 406/810] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:57.851698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffad39-b2fc-4106-84da-fcccff123c2c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.852204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffad39-b2fc-4106-84da-fcccff123c2c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.852204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffad39-b2fc-4106-84da-fcccff123c2c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.854146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 407/811] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:00:57.854603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffad39-b2fc-4106-84da-fcccff123c2c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:57.871717 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:57.907307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:57.919175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe204b-c139-468e-bdeb-025d7b2a9fc5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.955897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be262924-f2b9-4624-aaf9-c82b47a3a7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:57.956630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262924-f2b9-4624-aaf9-c82b47a3a7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.956980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262924-f2b9-4624-aaf9-c82b47a3a7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.957260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262924-f2b9-4624-aaf9-c82b47a3a7a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.958220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262924-f2b9-4624-aaf9-c82b47a3a7a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:57.958546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262924-f2b9-4624-aaf9-c82b47a3a7a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:57.959877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262924-f2b9-4624-aaf9-c82b47a3a7a2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:57.973387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffad39-b2fc-4106-84da-fcccff123c2c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:57.979569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 405/812] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:57.979569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a27a-983c-447d-baec-bc84a691577e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:57.979569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a27a-983c-447d-baec-bc84a691577e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:57.979569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7a27a-983c-447d-baec-bc84a691577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:57.998682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5ce7a27a-983c-447d-baec-bc84a691577e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:00:57.999878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5ce7a27a-983c-447d-baec-bc84a691577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:00:58.011036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.011718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.012064 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.012399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.013091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:58.013846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.015329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.025800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 408/813] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Sep 8 01:00:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:58.025800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.129284 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1b749-5f2b-4e89-a1f5-e532b29585d5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.130992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:58.166893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.167504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.167783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.168053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.168714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:58.169015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.170464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.183334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 409/814] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:00:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:58.184735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.198991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 406/815] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:00:58.200079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7a27a-983c-447d-baec-bc84a691577e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.253917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:58.292145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a101e-ea52-473f-8ec1-821bf06d2e76 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.320736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7a27a-983c-447d-baec-bc84a691577e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.329957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.330797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.331224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.331643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.339393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.341260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:00:58.356506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:58.358242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:58.359278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 410/816] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:58.359773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.365239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3314532-1f07-462d-879c-4db40401d99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.366168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3314532-1f07-462d-879c-4db40401d99c None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.366712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3314532-1f07-462d-879c-4db40401d99c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.367191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3314532-1f07-462d-879c-4db40401d99c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.368112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3314532-1f07-462d-879c-4db40401d99c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.370295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3314532-1f07-462d-879c-4db40401d99c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.387440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:58.403961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 407/817] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:00:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:00:58.405169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3314532-1f07-462d-879c-4db40401d99c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.504914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fe8ab-c55e-43ab-9d78-714912fabb57 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.572444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.573540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.574034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.574528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.587982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.589830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.601106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3314532-1f07-462d-879c-4db40401d99c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:58.606366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:58.607854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:58.609630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:58.609630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:58.609630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:58.609938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:58.612303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 411/818] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:58.617455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.657503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.658445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.658726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.659001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.659704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:58.660011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.661448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.675144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 408/819] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:58.675986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.702436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:58.736842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d7aeb-f08b-4032-a1ec-6b664f501a2e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.778226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.778867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.779767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.780061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] PATH_INFO: `/v3/services/network` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.780715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.782250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.787344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c3cf-4ba2-4b3e-9d6b-118a4d71a64e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:58.793083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:58.794270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:58.795185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 412/820] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:58 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:58.795943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.830149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.831321 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.831744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.832343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.833440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:58.834225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.835797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.851549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 409/821] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:58.852668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:58.886629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:58.926208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598991dc-53c6-4733-b0b3-b30601407474 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.964221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723b8e6-10ba-4eee-aec3-fd258d06f96c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:58.970718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f709359-f809-4bf7-97a3-c81bd9e3d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:58.971562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f709359-f809-4bf7-97a3-c81bd9e3d391 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:58.971987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f709359-f809-4bf7-97a3-c81bd9e3d391 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:58.972949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f709359-f809-4bf7-97a3-c81bd9e3d391 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/3c3d9f448692440fbeee652da473fd05/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:58.975520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f709359-f809-4bf7-97a3-c81bd9e3d391 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=3c3d9f448692440fbeee652da473fd05, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:58.977865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f709359-f809-4bf7-97a3-c81bd9e3d391 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:58.981469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:59.004854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:59.005266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 413/822] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:00:58 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/3c3d9f448692440fbeee652da473fd05/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:00:59.005651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:59.006203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:59.006661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:59.007071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f709359-f809-4bf7-97a3-c81bd9e3d391 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:59.007609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:59.008009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:59.009943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:59.026406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 410/823] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:00:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:59.032149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:59.127242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f709359-f809-4bf7-97a3-c81bd9e3d391 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:59.166143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:59.167571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:59.168279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:59.168719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:59.179093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:59.180959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:00:59.195895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:59.196896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:00:59.199017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:59.201358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 414/824] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:00:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:59.211726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:59.249696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:59.262981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28af0ac-47ac-4955-8031-aa258a97eec7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:59.316487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:59.318337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:59.319323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:59.319636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:59.319912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:59.320994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:59.321314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:59.323032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:59.329815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 411/825] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:00:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:59.336481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:59.378131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6b9a7-11c0-43ae-8326-2072c3728216 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:59.425225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:59.426106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:59.426557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:59.426974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:59.427844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:59.428293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:59.429943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:59.463002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 415/826] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 8 01:00:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:00:59.469674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:59.489659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3cee-6051-43e0-8fd1-27998593f0e5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:59.578119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd39e66-9a16-4683-a04c-52a286db098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:59.578749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39e66-9a16-4683-a04c-52a286db098e None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:59.579034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39e66-9a16-4683-a04c-52a286db098e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:59.579313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd39e66-9a16-4683-a04c-52a286db098e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:59.580003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd39e66-9a16-4683-a04c-52a286db098e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:59.581387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd39e66-9a16-4683-a04c-52a286db098e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:59.582738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37535-246d-4cb7-8a53-03e25f42ef38 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:59.599003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:59.621657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:59.622319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:59.622605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:59.623459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:59.628498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 412/827] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:00:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:00:59.643560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:59.645110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:00:59.666047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:00:59.667048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:00:59.667907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:00:59.667907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:00:59.667907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:00:59.667907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 416/828] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:00:59.673183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd39e66-9a16-4683-a04c-52a286db098e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:00:59.693597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:00:59.864972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd39e66-9a16-4683-a04c-52a286db098e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:00:59.906875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5881c-09f2-41b3-b763-c470904bc31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:00:59.907511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5881c-09f2-41b3-b763-c470904bc31e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:00:59.907791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5881c-09f2-41b3-b763-c470904bc31e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:00:59.908064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5881c-09f2-41b3-b763-c470904bc31e None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:00:59.908732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5881c-09f2-41b3-b763-c470904bc31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:00:59.909037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5881c-09f2-41b3-b763-c470904bc31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:00:59.910466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5881c-09f2-41b3-b763-c470904bc31e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:00:59.925810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 413/829] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:00:59.931468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:00.018213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74021-32c9-41f3-aa9b-581420055650 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.018410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74021-32c9-41f3-aa9b-581420055650 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.018681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74021-32c9-41f3-aa9b-581420055650 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.020463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 414/830] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:00.025676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d391b-76a9-4c2e-844d-d1861b7e869f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.026023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d391b-76a9-4c2e-844d-d1861b7e869f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.026304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d391b-76a9-4c2e-844d-d1861b7e869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.041772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb41c5-2ee1-446d-839d-378298aeb970 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:00.048078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-538d391b-76a9-4c2e-844d-d1861b7e869f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:00.049283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-538d391b-76a9-4c2e-844d-d1861b7e869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:00.084524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:00.085666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.086147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.086616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.096135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:00.097959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:00.113451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:00.114323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:00.115196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:00.115196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:00.115196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:00.115196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:00.115196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:00.115196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:00.115196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:00.115196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:00.117652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:00.119746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 417/831] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:00.125204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:00.137769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 415/832] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:00.156015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:00.236394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adf593-e0dc-449f-b2b5-d57efe5515eb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:00.275019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:00.275956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.276436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.276953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.277872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:00.278401 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:00.280703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:00.293985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 418/833] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:00.300139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d391b-76a9-4c2e-844d-d1861b7e869f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:00.405673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d391b-76a9-4c2e-844d-d1861b7e869f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:00.430713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:00.452617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3204-76ce-45d1-b181-65dc3359b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:00.453664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3204-76ce-45d1-b181-65dc3359b051 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.454146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3204-76ce-45d1-b181-65dc3359b051 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.454615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3204-76ce-45d1-b181-65dc3359b051 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/912d86eef7b64c0a8b260ae7a804991d/roles/2c6f5ddd2cca40019b4efa72a509dfd2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.476655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d3204-76ce-45d1-b181-65dc3359b051 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=912d86eef7b64c0a8b260ae7a804991d, role_id=2c6f5ddd2cca40019b4efa72a509dfd2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:00.479075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d3204-76ce-45d1-b181-65dc3359b051 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:00.498581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 416/834] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:01:00 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/912d86eef7b64c0a8b260ae7a804991d/roles/2c6f5ddd2cca40019b4efa72a509dfd2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:01:00.552950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:00.570706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933759fa-bb5e-4704-a754-13a8bf673fcf None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:00.611704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:00.612358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.612636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.612915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.613532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:00.614981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:00.624929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:00.625945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:00.626813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 419/835] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Sep 8 01:01:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:00.634391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3204-76ce-45d1-b181-65dc3359b051 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:00.689164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:00.752726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3204-76ce-45d1-b181-65dc3359b051 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:00.795239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbd6d-be5e-40a7-b63e-fc820d59c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:00.796240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbd6d-be5e-40a7-b63e-fc820d59c29d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.796670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbd6d-be5e-40a7-b63e-fc820d59c29d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.797102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbd6d-be5e-40a7-b63e-fc820d59c29d None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.797916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dbd6d-be5e-40a7-b63e-fc820d59c29d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:00.798366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dbd6d-be5e-40a7-b63e-fc820d59c29d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:00.799975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dbd6d-be5e-40a7-b63e-fc820d59c29d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:00.805807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 417/836] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:00.813436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:00.892082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258640bd-8534-4f1e-8b9c-0aad086b51a3 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.892598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258640bd-8534-4f1e-8b9c-0aad086b51a3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.892598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258640bd-8534-4f1e-8b9c-0aad086b51a3 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.894203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 418/837] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:00.899337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad15c3-5726-4ebd-b7be-71256663ec75 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.899618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad15c3-5726-4ebd-b7be-71256663ec75 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.899894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad15c3-5726-4ebd-b7be-71256663ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.922046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-64ad15c3-5726-4ebd-b7be-71256663ec75 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:00.923137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1f9dc-3ba6-4a18-bca3-7db064268cd4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:00.923279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-64ad15c3-5726-4ebd-b7be-71256663ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:00.963788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:00.964399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:00.964680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:00.964950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:00.965672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:00.965976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:00.967931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:00.981901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 420/838] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:01.003424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 419/839] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:01.274140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:01.290946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:01.380880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad960-bce6-4516-a7dc-3774e54a0942 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:01.415731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:01.416363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:01.416641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:01.416912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:01.417519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:01.418943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:01.428683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:01.429697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:01.430548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 421/840] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:01.436212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad15c3-5726-4ebd-b7be-71256663ec75 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:01.486049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:01.555342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad15c3-5726-4ebd-b7be-71256663ec75 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:01.590617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf034c2-8319-4ad3-9bfa-8b5bc61e6830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:01.591235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf034c2-8319-4ad3-9bfa-8b5bc61e6830 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:01.591585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf034c2-8319-4ad3-9bfa-8b5bc61e6830 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:01.591863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf034c2-8319-4ad3-9bfa-8b5bc61e6830 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:01.592499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf034c2-8319-4ad3-9bfa-8b5bc61e6830 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:01.592806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf034c2-8319-4ad3-9bfa-8b5bc61e6830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:01.594226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf034c2-8319-4ad3-9bfa-8b5bc61e6830 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:01.599177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 420/841] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:01.604671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:01.621034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60455451-0100-4a83-8c29-bf9ee7461d0a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:01.621325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60455451-0100-4a83-8c29-bf9ee7461d0a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:01.621641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60455451-0100-4a83-8c29-bf9ee7461d0a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:01.623269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 421/842] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:01.628107 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdd098-1141-4d79-9f03-47a262aa01eb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:01.628394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdd098-1141-4d79-9f03-47a262aa01eb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:01.628673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdd098-1141-4d79-9f03-47a262aa01eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:01.646997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-aabdd098-1141-4d79-9f03-47a262aa01eb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:01.648197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aabdd098-1141-4d79-9f03-47a262aa01eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:01.709066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:01.722409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e4e72-34a0-4c7e-9438-1a6d5e568248 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:01.733493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 422/843] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:01.765128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:01.765765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:01.766043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:01.766318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:01.766949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:01.767253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:01.768613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:01.773754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 422/844] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:02.009011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdd098-1141-4d79-9f03-47a262aa01eb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:02.043524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:02.112161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdd098-1141-4d79-9f03-47a262aa01eb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:02.147264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f583e6a-16e7-41b1-839b-895bb05d6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:02.147895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f583e6a-16e7-41b1-839b-895bb05d6e1a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:02.148177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f583e6a-16e7-41b1-839b-895bb05d6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:02.148449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f583e6a-16e7-41b1-839b-895bb05d6e1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:02.158962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f583e6a-16e7-41b1-839b-895bb05d6e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2f583e6a-16e7-41b1-839b-895bb05d6e1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:02.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:02.164768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:01:02.165642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:02.170315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 423/845] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:02.171901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:02.284240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a534f4b-2e39-4a9a-9394-286126d386c2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:02.320710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:02.321731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:02.322237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:02.322712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:02.323573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:02.324095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:02.326277 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:02.335693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 423/846] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:02.344246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f583e6a-16e7-41b1-839b-895bb05d6e1a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:02.439139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:02.446284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f583e6a-16e7-41b1-839b-895bb05d6e1a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:02.483324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:02.484021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:02.484316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:02.484569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:02.499092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:02.500639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:02.528357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:02.529370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:02.530742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:02.530742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:02.530742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:02.530742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 424/847] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:02.535616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:02.540617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:02.643741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d493c-fac1-403f-9346-62b808336f21 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:02.678163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf080e-d642-4867-a1a9-ed3a1e22debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:02.678768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf080e-d642-4867-a1a9-ed3a1e22debb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:02.679043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf080e-d642-4867-a1a9-ed3a1e22debb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:02.679314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf080e-d642-4867-a1a9-ed3a1e22debb None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:02.679954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf080e-d642-4867-a1a9-ed3a1e22debb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:02.680257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf080e-d642-4867-a1a9-ed3a1e22debb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:02.681655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf080e-d642-4867-a1a9-ed3a1e22debb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:02.695428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 424/848] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:02.701128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:02.813570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806cd35-40ae-4d3e-9621-c63bb09afe96 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:02.817858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b8e5-1b83-444f-83a9-b149a8abce69 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:02.818424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b8e5-1b83-444f-83a9-b149a8abce69 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:02.820284 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68b8e5-1b83-444f-83a9-b149a8abce69 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:02.822635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 425/849] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:02.828900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c73d0-88f6-4daa-9f4b-fcc28edda250 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:02.829181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c73d0-88f6-4daa-9f4b-fcc28edda250 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:02.829476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c73d0-88f6-4daa-9f4b-fcc28edda250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:02.849792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0a5c73d0-88f6-4daa-9f4b-fcc28edda250 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:02.851719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0a5c73d0-88f6-4daa-9f4b-fcc28edda250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:02.856176 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:02.856818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:02.857130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:02.857422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:02.866124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:02.867696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:02.880195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:02.881124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:02.882498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 425/850] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:01:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:02.887507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:02.897755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:02.920229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:02.931951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 426/851] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:02.996220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867fc5-3455-4626-80c5-a9481a900f5b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:03.032207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:03.032910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.033203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.033507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.034246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:03.034553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:03.035982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:03.054846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 426/852] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Sep 8 01:01:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:03.060558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c73d0-88f6-4daa-9f4b-fcc28edda250 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:03.175234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c73d0-88f6-4daa-9f4b-fcc28edda250 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:03.196923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:03.212177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826801d1-9ec7-41b3-a2dd-0e9df5360341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:03.212810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826801d1-9ec7-41b3-a2dd-0e9df5360341 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.213086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826801d1-9ec7-41b3-a2dd-0e9df5360341 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.213361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826801d1-9ec7-41b3-a2dd-0e9df5360341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.281843 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:03.284991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:03.294598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826801d1-9ec7-41b3-a2dd-0e9df5360341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:03.296108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826801d1-9ec7-41b3-a2dd-0e9df5360341 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:03.332534 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44fedb-5ee9-4767-ae79-dd7118ca5554 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:03.368367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dfba1-8f2e-477b-b492-a4d47018e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:03.368995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dfba1-8f2e-477b-b492-a4d47018e97c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.369278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dfba1-8f2e-477b-b492-a4d47018e97c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.369604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dfba1-8f2e-477b-b492-a4d47018e97c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.380435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dfba1-8f2e-477b-b492-a4d47018e97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-da2dfba1-8f2e-477b-b492-a4d47018e97c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:03.385256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:03.386235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:03.387084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 427/853] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:01:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:03.387757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948dadc-6b40-4536-9e61-5db31492a3aa None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.388615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948dadc-6b40-4536-9e61-5db31492a3aa None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.388615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948dadc-6b40-4536-9e61-5db31492a3aa None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.393444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 428/854] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:03.393444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948dadc-6b40-4536-9e61-5db31492a3aa None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:03.407335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 427/855] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:01:03.408748 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41712-61ff-4ede-a44a-d0f45aaa0cbb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.409036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41712-61ff-4ede-a44a-d0f45aaa0cbb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.409309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41712-61ff-4ede-a44a-d0f45aaa0cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.428455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4af41712-61ff-4ede-a44a-d0f45aaa0cbb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:03.429591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4af41712-61ff-4ede-a44a-d0f45aaa0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:03.505448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 428/856] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:03.505448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af41712-61ff-4ede-a44a-d0f45aaa0cbb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:03.520453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948dadc-6b40-4536-9e61-5db31492a3aa None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:03.535482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:03.550813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:03.565773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:03.566620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.567159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.567584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.568382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:03.568835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:03.570631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:03.584092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 429/857] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:01:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:03.585131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:03.625970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af41712-61ff-4ede-a44a-d0f45aaa0cbb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:03.666892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:03.667534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.667819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.668097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.680712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:03.689425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:03.698614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1733-17d7-4f49-a339-d74bd5493686 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:03.702467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:03.703374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:03.704247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:03.704247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:03.704247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:03.704247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 429/858] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:03.709054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:03.744287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:03.745251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.745562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.746134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.759161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:03.760953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:03.779827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:03.780975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:03.782627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:03.782627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:03.782627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:03.786248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 430/859] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:03.787525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:03.813236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:03.837292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:03.839223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b61c-4413-4350-8a36-a50b689ab12f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:03.877093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:03.877732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.878021 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.878291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.878938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:03.879244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:03.880607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:03.894263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 430/860] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:03.899374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:03.904982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb86724-0ae5-40bd-ad29-c2448a668ae1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:03.945207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:03.945773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:03.946450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:03.946726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:03.947733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:03.948116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:03.949899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:03.963476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 431/861] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:03.964315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:04.015631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd1ec-97cf-4896-b891-8f05f0621f62 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:04.052257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6101-9f24-4a3e-b3e2-d756faa3e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:04.052864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6101-9f24-4a3e-b3e2-d756faa3e1f9 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.053148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6101-9f24-4a3e-b3e2-d756faa3e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.053457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6101-9f24-4a3e-b3e2-d756faa3e1f9 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.054304 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6101-9f24-4a3e-b3e2-d756faa3e1f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:04.055454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6101-9f24-4a3e-b3e2-d756faa3e1f9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:04.059734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:04.067138 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:04.070924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58ff5c-770e-4c2c-909c-a57170b93342 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:04.072469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 431/862] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:01:03 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:01:04.073257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6101-9f24-4a3e-b3e2-d756faa3e1f9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:04.119868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ece0-704c-4fc9-89d6-761baafc7d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:04.120909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ece0-704c-4fc9-89d6-761baafc7d1b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.121186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ece0-704c-4fc9-89d6-761baafc7d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.121481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ece0-704c-4fc9-89d6-761baafc7d1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.129752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ece0-704c-4fc9-89d6-761baafc7d1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:04.131437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ece0-704c-4fc9-89d6-761baafc7d1b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3612ece0-704c-4fc9-89d6-761baafc7d1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:04.144133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:04.145149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:04.146158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 432/863] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:04.146640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01abfbb-1d9e-4e44-81d5-264527f02b7a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.147201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01abfbb-1d9e-4e44-81d5-264527f02b7a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.147201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01abfbb-1d9e-4e44-81d5-264527f02b7a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.148562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 433/864] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:04.153475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01abfbb-1d9e-4e44-81d5-264527f02b7a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:04.196893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6101-9f24-4a3e-b3e2-d756faa3e1f9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:04.237102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ead712-7746-419d-92c7-0c36b008b6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:04.237754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead712-7746-419d-92c7-0c36b008b6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.238037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead712-7746-419d-92c7-0c36b008b6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.238351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead712-7746-419d-92c7-0c36b008b6f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.247420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ead712-7746-419d-92c7-0c36b008b6f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:04.249437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ead712-7746-419d-92c7-0c36b008b6f4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d1ead712-7746-419d-92c7-0c36b008b6f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:04.262905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:04.264231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 432/865] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:01:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:04.265826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1ee5-9ad6-4b59-a983-b44de1cbfe70 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.266475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01abfbb-1d9e-4e44-81d5-264527f02b7a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:04.266548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1ee5-9ad6-4b59-a983-b44de1cbfe70 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.266548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1ee5-9ad6-4b59-a983-b44de1cbfe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.285450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7dbd1ee5-9ad6-4b59-a983-b44de1cbfe70 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:04.286683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7dbd1ee5-9ad6-4b59-a983-b44de1cbfe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:04.306162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:04.306780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.307063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.307339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.308469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:04.308784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:04.310479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:04.322517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 434/866] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:04.323310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:04.343487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:04.347789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:04.373429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 433/867] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:04 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:04.373429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd1ee5-9ad6-4b59-a983-b44de1cbfe70 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:04.464187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abe1c3-84a9-4bf6-a0d9-7edd62130bab None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:04.479591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd1ee5-9ad6-4b59-a983-b44de1cbfe70 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:04.514353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:04.514977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.515255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.517624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.518398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:04.518707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:04.520140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:04.527375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:04.527990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.528275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.528817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.530125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=454105f786874ed1b407da41aef24389, user.id=3c3d9f448692440fbeee652da473fd05) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:04.531333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:04.532765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:04.540075 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 434/868] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:04 2022] GET /identity/v3/role_assignments?user.id=3c3d9f448692440fbeee652da473fd05&scope.project.id=454105f786874ed1b407da41aef24389&role.id=c182619b007b495f912901d866e751e1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:04.540492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 435/869] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 8 01:01:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:04.545925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:04.606787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:04.662596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004205-8b44-48bb-8b04-50e8ccd8dd5d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:04.682045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:04.709670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a10e6-ecdf-44be-9e47-1c7f96f97bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:04.710686 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a10e6-ecdf-44be-9e47-1c7f96f97bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.710962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a10e6-ecdf-44be-9e47-1c7f96f97bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.711234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a10e6-ecdf-44be-9e47-1c7f96f97bf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.769094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:04.797186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a10e6-ecdf-44be-9e47-1c7f96f97bf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:04.798703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a10e6-ecdf-44be-9e47-1c7f96f97bf9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:04.814681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76fadd-c456-4b46-ad22-4fe2eef9c2f5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:04.856998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e348f-3823-4871-898a-505a2205c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:04.857979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e348f-3823-4871-898a-505a2205c6bd None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:04.858434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e348f-3823-4871-898a-505a2205c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:04.858876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e348f-3823-4871-898a-505a2205c6bd None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:04.860132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e348f-3823-4871-898a-505a2205c6bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:04.862086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e348f-3823-4871-898a-505a2205c6bd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:04.870966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:04.884197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 436/870] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:01:04 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:01:04.922066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 435/871] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:04 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 01:01:04.927539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e348f-3823-4871-898a-505a2205c6bd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:05.060973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e348f-3823-4871-898a-505a2205c6bd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:05.089159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:05.097937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:05.099163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:05.099607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:05.099880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:05.111501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:05.112944 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:05.127533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:05.128493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:05.129382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:05.129382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:05.129382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:05.129382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 437/872] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:05.135801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a10e6-ecdf-44be-9e47-1c7f96f97bf9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:05.246536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a10e6-ecdf-44be-9e47-1c7f96f97bf9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:05.283884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:05.284499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:05.284776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:05.285048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:05.285725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:05.286028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:05.287398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:05.300300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 436/873] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:05.305965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:05.412983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a365-ec91-4edf-9117-260dd9d219a7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:05.449204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:05.450231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:05.450794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:05.451294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:05.458502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:05.460162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:05.472348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:05.473246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:05.474149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:05.474149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:05.474149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:05.474149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:05.474149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:05.474149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:05.474149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:05.474149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:05.476513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 438/874] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:05.482663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:05.495937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:05.593267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadb07c-d48b-4959-8ecc-871bde68da7a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:05.628131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f547e7d-f5c7-46e8-9604-1a436ee535b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:05.628737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547e7d-f5c7-46e8-9604-1a436ee535b9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:05.629015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547e7d-f5c7-46e8-9604-1a436ee535b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:05.629286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547e7d-f5c7-46e8-9604-1a436ee535b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:05.630001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f547e7d-f5c7-46e8-9604-1a436ee535b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:05.630306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f547e7d-f5c7-46e8-9604-1a436ee535b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:05.631730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f547e7d-f5c7-46e8-9604-1a436ee535b9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:05.645685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 437/875] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:05.651913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:05.696883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:05.759632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5f4a-2bf2-44a6-8c96-3366a3f9c1d4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:05.794971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777066-674c-40c5-a200-b4ad547d6048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:05.795585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777066-674c-40c5-a200-b4ad547d6048 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:05.795870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777066-674c-40c5-a200-b4ad547d6048 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:05.796142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777066-674c-40c5-a200-b4ad547d6048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:05.796876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777066-674c-40c5-a200-b4ad547d6048 None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=912d86eef7b64c0a8b260ae7a804991d) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:05.797191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777066-674c-40c5-a200-b4ad547d6048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:05.798647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777066-674c-40c5-a200-b4ad547d6048 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:05.804841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 439/876] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:05 2022] GET /identity/v3/role_assignments?user.id=912d86eef7b64c0a8b260ae7a804991d&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:06.366739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3cf58-647c-4e55-b7f0-c49748ae256a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:06.367810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3cf58-647c-4e55-b7f0-c49748ae256a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:06.368319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3cf58-647c-4e55-b7f0-c49748ae256a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:06.370178 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 438/877] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:06.376317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe915b-e8ae-42d0-adc1-11937926e1a7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:06.377167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe915b-e8ae-42d0-adc1-11937926e1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:06.377703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe915b-e8ae-42d0-adc1-11937926e1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:06.397192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6dfe915b-e8ae-42d0-adc1-11937926e1a7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:06.398705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6dfe915b-e8ae-42d0-adc1-11937926e1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:06.470171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 440/878] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:06.738579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3cf58-647c-4e55-b7f0-c49748ae256a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:06.808987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820da69c-478c-4934-913c-e94c0fe92188 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:06.809336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820da69c-478c-4934-913c-e94c0fe92188 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:06.809610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820da69c-478c-4934-913c-e94c0fe92188 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:06.812306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 441/879] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:06.816284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cecb59-bb88-435f-8f03-1534b5487853 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:06.816566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cecb59-bb88-435f-8f03-1534b5487853 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:06.816839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cecb59-bb88-435f-8f03-1534b5487853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:06.818855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:06.840608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c3cecb59-bb88-435f-8f03-1534b5487853 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:06.842544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3cecb59-bb88-435f-8f03-1534b5487853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:06.863009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3cf58-647c-4e55-b7f0-c49748ae256a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:06.879800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:06.900646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:06.901289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:06.901594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:06.901869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:06.902456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:06.904505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:06.918114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:06.919363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:06.920588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 439/880] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Sep 8 01:01:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:06.928608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:06.939456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 442/881] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:07.038829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521b478-128d-4e53-b612-18f823aaf1ad None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.075131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ec52-359d-47a9-8a11-d601f1c5edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.076224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ec52-359d-47a9-8a11-d601f1c5edf7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.076666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ec52-359d-47a9-8a11-d601f1c5edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.077112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ec52-359d-47a9-8a11-d601f1c5edf7 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.077984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486ec52-359d-47a9-8a11-d601f1c5edf7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:07.078456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486ec52-359d-47a9-8a11-d601f1c5edf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.080029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486ec52-359d-47a9-8a11-d601f1c5edf7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.081529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:07.086941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 440/882] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:07.094800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cecb59-bb88-435f-8f03-1534b5487853 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:07.194236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb78f1-d0fa-43f3-bb2c-db42e2353171 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.195017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb78f1-d0fa-43f3-bb2c-db42e2353171 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.195596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb78f1-d0fa-43f3-bb2c-db42e2353171 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.197561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 441/883] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:07.203862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd112ff1-c23b-463f-9cbe-1e7f99d615e3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.204391 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd112ff1-c23b-463f-9cbe-1e7f99d615e3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.204872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd112ff1-c23b-463f-9cbe-1e7f99d615e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.205140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cecb59-bb88-435f-8f03-1534b5487853 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.223549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fd112ff1-c23b-463f-9cbe-1e7f99d615e3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:07.224905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fd112ff1-c23b-463f-9cbe-1e7f99d615e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:07.252251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.252865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.253148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.253443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.254085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:07.254391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.255755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.267297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 443/884] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:07.267297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:07.295101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:07.321427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 442/885] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:07.321427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd112ff1-c23b-463f-9cbe-1e7f99d615e3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:07.389216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9a33f-cb44-4dd6-9209-b482058b694e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.433832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.434606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.435019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.435393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.436096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.437586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.437705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd112ff1-c23b-463f-9cbe-1e7f99d615e3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:07.446828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:07.447983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:07.448819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:07.449830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 444/886] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:07.456196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:07.468305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:07.480768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.482417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.482864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.483444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.484383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] RBAC: Adding query filter params (interface=public, service_id=98da7badf52e4ffaaf31c0ffbc49a533, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:07.484842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.486385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.493366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 443/887] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/endpoints?service_id=98da7badf52e4ffaaf31c0ffbc49a533&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:07.498792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:07.563420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:07.573899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ad13-06be-44cd-b1e7-f6b7ab2007fa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.610068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.610677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.610961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.611238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.611866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:07.612169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.613561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.621463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 445/888] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:07.621463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:07.633248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d546f6-bca1-45b9-9b8b-c317c749cb02 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.671007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101612b3-f15d-4ea7-b318-eaaf4ed449be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.671611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101612b3-f15d-4ea7-b318-eaaf4ed449be None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.671998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101612b3-f15d-4ea7-b318-eaaf4ed449be None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.672276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101612b3-f15d-4ea7-b318-eaaf4ed449be None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.672871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101612b3-f15d-4ea7-b318-eaaf4ed449be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.674249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101612b3-f15d-4ea7-b318-eaaf4ed449be None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.689772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 444/889] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/services => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:01:07.690683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101612b3-f15d-4ea7-b318-eaaf4ed449be None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:07.738134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7ba2b-eebc-4c6e-a31d-1b8f558802c8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.774261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:07.787124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.787782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.788062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.788343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.789014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.790477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:07.803881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:07.804956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:07.810777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 446/890] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:07.814069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:07.833688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101612b3-f15d-4ea7-b318-eaaf4ed449be None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.840651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:07.880487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.880487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.880487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.880487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.880914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:07.880914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.882765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.889363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 445/891] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:07.940249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728cd69-096e-46cd-acb7-dbb5ef7ee24b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:07.983286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fced6-5516-49f4-a127-62fd497547cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:07.984313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fced6-5516-49f4-a127-62fd497547cb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:07.984832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fced6-5516-49f4-a127-62fd497547cb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:07.985341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fced6-5516-49f4-a127-62fd497547cb None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:07.986249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fced6-5516-49f4-a127-62fd497547cb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:07.986777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fced6-5516-49f4-a127-62fd497547cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:07.988401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fced6-5516-49f4-a127-62fd497547cb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:07.994848 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 447/892] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:08.003629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:08.120970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ee8af-a478-4dc0-a736-28795b9f0869 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:08.143037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:08.146097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce11deb-a7c0-4249-9fa4-ac94585f8756 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:08.146385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce11deb-a7c0-4249-9fa4-ac94585f8756 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:08.146663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce11deb-a7c0-4249-9fa4-ac94585f8756 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:08.148237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 448/893] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:08.153338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc59d0-95a2-4f55-8d88-9e950f85de58 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:08.153676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc59d0-95a2-4f55-8d88-9e950f85de58 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:08.153985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc59d0-95a2-4f55-8d88-9e950f85de58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:08.158872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:08.159589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:08.160099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:08.160326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:08.161459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:08.161459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:08.162911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:08.168439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 446/894] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:08.173191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2abc59d0-95a2-4f55-8d88-9e950f85de58 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:08.174291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:08.174769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2abc59d0-95a2-4f55-8d88-9e950f85de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:08.269470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 449/895] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:08.299888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7473e15-e1ac-4003-9b89-aa4977cc0e8a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:08.334786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:08.335399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:08.335683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:08.335956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:08.336658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] RBAC: Adding query filter params (interface=public, service_id=f2c8e9a86f904fae9c9320c9f4745d3a, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:08.336970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:08.338357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:08.344425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 447/896] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 8 01:01:08 2022] GET /identity/v3/endpoints?service_id=f2c8e9a86f904fae9c9320c9f4745d3a&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:08.349870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc59d0-95a2-4f55-8d88-9e950f85de58 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:08.365857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:08.455888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc59d0-95a2-4f55-8d88-9e950f85de58 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:08.494621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cdb13-8a92-494b-bd42-b2095a129cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:08.495238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cdb13-8a92-494b-bd42-b2095a129cfb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:08.495522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cdb13-8a92-494b-bd42-b2095a129cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:08.495798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cdb13-8a92-494b-bd42-b2095a129cfb None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:08.496410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cdb13-8a92-494b-bd42-b2095a129cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:08.498352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cdb13-8a92-494b-bd42-b2095a129cfb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:08.506609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 450/897] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:01:08 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:01:08.556084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:08.617843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:08.681534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16e5a1-a803-4f34-af34-2a044d9dfd92 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:08.717986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe245c5-f486-47f7-814a-600850e64d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:08.718540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe245c5-f486-47f7-814a-600850e64d09 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:08.718819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe245c5-f486-47f7-814a-600850e64d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:08.719094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe245c5-f486-47f7-814a-600850e64d09 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:08.731002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe245c5-f486-47f7-814a-600850e64d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8fe245c5-f486-47f7-814a-600850e64d09 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:08.736617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:08.737564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:08.738533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 448/898] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 8 01:01:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:08.745645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cdb13-8a92-494b-bd42-b2095a129cfb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:08.829574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:08.855256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cdb13-8a92-494b-bd42-b2095a129cfb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:08.894397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:08.895015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:08.895299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:08.895576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:08.896249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:08.896557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:08.897965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:08.907072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 451/899] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 8 01:01:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:08.912739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe245c5-f486-47f7-814a-600850e64d09 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:09.015177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe245c5-f486-47f7-814a-600850e64d09 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:09.030262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:09.050224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:09.051185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:09.051678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:09.052174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:09.063472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:09.065145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:09.080409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:09.081465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:09.082342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:09.082342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:09.082342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:09.088773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 449/900] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:09.090329 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:09.195027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a8296-efec-4031-a404-a256b6a955a2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:09.230240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:09.230859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:09.231143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:09.231418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:09.232124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:09.232426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:09.233837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:09.246491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 452/901] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:09.249782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:09.253141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:09.357548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd87f-27b9-498f-a8de-3213616137fc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:09.395948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:09.396580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:09.396862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:09.397137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:09.405889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:09.407383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:09.420827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:09.421866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:09.423015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 450/902] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:01:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:09.429861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:09.541824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564a599-9dd5-48d7-a52e-5843a78adc36 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:09.580041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:09.580999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:09.581668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:09.582168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:09.583106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:09.583611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:09.585212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:09.612704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 453/903] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 8 01:01:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:09.614479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:09.637430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:09.718902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7afbf8-cb88-487d-9c83-f5acb6bbb932 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:09.753063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575b993-e4fa-44a7-9263-6eed024614a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:09.754050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575b993-e4fa-44a7-9263-6eed024614a5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:09.754553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575b993-e4fa-44a7-9263-6eed024614a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:09.755033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575b993-e4fa-44a7-9263-6eed024614a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:09.828006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575b993-e4fa-44a7-9263-6eed024614a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:09.829833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575b993-e4fa-44a7-9263-6eed024614a5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:09.852255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:09.950855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 451/904] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:09 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:01:09.952556 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:10.012184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:10.052915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca0f6-f89f-4979-baa8-fba1c6dcb0fb None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.053631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca0f6-f89f-4979-baa8-fba1c6dcb0fb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.054141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ca0f6-f89f-4979-baa8-fba1c6dcb0fb None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.059489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1f60e-a08e-47de-90aa-aaebe8efd33e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:10.060363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 452/905] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:10.062007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451270-962f-4eff-bd20-5351736ad86b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.062495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451270-962f-4eff-bd20-5351736ad86b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.062982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451270-962f-4eff-bd20-5351736ad86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.083732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bb451270-962f-4eff-bd20-5351736ad86b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:10.085125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bb451270-962f-4eff-bd20-5351736ad86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:10.103440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:10.104654 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.105155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.105849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.120011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:10.123076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:10.142476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:10.143448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:10.144307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:10.144307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:10.144307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:10.151552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 454/906] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:10.153327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:10.181266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 453/907] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:10.277055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5839-4f2a-4967-a711-6a9dc851d79c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.277342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5839-4f2a-4967-a711-6a9dc851d79c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.277558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5839-4f2a-4967-a711-6a9dc851d79c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.278525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654097b7-69e1-4125-8cd9-4913e4013bad None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:10.279158 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 454/908] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:10.284125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d1f8-cfd0-4093-910c-bf3254165baa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.284408 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d1f8-cfd0-4093-910c-bf3254165baa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.284683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d1f8-cfd0-4093-910c-bf3254165baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.289636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:10.307266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f587d1f8-cfd0-4093-910c-bf3254165baa None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:10.308459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f587d1f8-cfd0-4093-910c-bf3254165baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:10.316524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:10.317135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.317427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.318005 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.318492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:10.318798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:10.320279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:10.333761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 455/909] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:10.339598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:10.366699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:10.397504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 455/910] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:10.464860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d71db-d0e9-4b52-a7a0-211871753b8d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:10.475309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587d1f8-cfd0-4093-910c-bf3254165baa None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:10.515393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:10.515840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.516122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.516396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.524465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:10.526001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:10.537872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:10.538781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:10.539727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:10.539727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:10.539727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:10.539727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:10.539727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:10.539727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:10.539727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:10.539727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:10.543849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 456/911] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:10.545279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:10.584055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:10.611570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587d1f8-cfd0-4093-910c-bf3254165baa None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:10.653093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:10.654440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.654650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.654925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.655814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:10.656984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:10.666764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:10.667885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:10.669115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 456/912] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Sep 8 01:01:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:10.673394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:10.684052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ca071-7339-4c7a-abc4-238459a5cdc3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:10.723431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:10.723666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:10.724206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.724906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.725152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.726303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:10.726586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:10.728386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:10.740978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 457/913] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:10.741830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:10.782436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de061e5-c3e8-4d0d-a29f-ffe4b6863663 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:10.817360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1022ba-6235-43c0-8287-dfa90928b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:10.817929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1022ba-6235-43c0-8287-dfa90928b2f4 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.818209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1022ba-6235-43c0-8287-dfa90928b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.818482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1022ba-6235-43c0-8287-dfa90928b2f4 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.819132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1022ba-6235-43c0-8287-dfa90928b2f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:10.820489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1022ba-6235-43c0-8287-dfa90928b2f4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:10.830917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:10.836430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 457/914] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:01:10 2022] POST /identity/v3/services => generated 241 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:01:10.837675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4b579-ee04-4c86-bc14-c156a74c5668 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.838130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4b579-ee04-4c86-bc14-c156a74c5668 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.838410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4b579-ee04-4c86-bc14-c156a74c5668 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.840122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 458/915] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:10.840716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4b579-ee04-4c86-bc14-c156a74c5668 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:10.842916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625be03e-fb22-43c1-b81b-7831f5ee5d8b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:10.888983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80df33e-a299-419e-98cc-94a773c4d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:10.889648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df33e-a299-419e-98cc-94a773c4d869 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.889927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df33e-a299-419e-98cc-94a773c4d869 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.890191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80df33e-a299-419e-98cc-94a773c4d869 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.890930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df33e-a299-419e-98cc-94a773c4d869 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:10.891229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df33e-a299-419e-98cc-94a773c4d869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:10.892646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80df33e-a299-419e-98cc-94a773c4d869 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:10.898294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 458/916] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:10.899499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf40339-b94b-4bd4-81fa-b943a8690f8d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:10.899785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf40339-b94b-4bd4-81fa-b943a8690f8d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:10.900052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf40339-b94b-4bd4-81fa-b943a8690f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:10.920053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cbf40339-b94b-4bd4-81fa-b943a8690f8d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:10.921820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cbf40339-b94b-4bd4-81fa-b943a8690f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:10.972424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4b579-ee04-4c86-bc14-c156a74c5668 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:10.975830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:11.000533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 459/917] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:11.001852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf40339-b94b-4bd4-81fa-b943a8690f8d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:11.025338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:11.026093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:11.026477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:11.026737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:11.027465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] RBAC: Adding query filter params (role.id=27f2eddc8e8843c79e44d0a15aec14ca, scope.project.id=454105f786874ed1b407da41aef24389, user.id=912d86eef7b64c0a8b260ae7a804991d) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:11.027832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:11.029392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:11.036495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 459/918] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:10 2022] GET /identity/v3/role_assignments?user.id=912d86eef7b64c0a8b260ae7a804991d&scope.project.id=454105f786874ed1b407da41aef24389&role.id=27f2eddc8e8843c79e44d0a15aec14ca => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:11.117922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:11.131361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf40339-b94b-4bd4-81fa-b943a8690f8d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:11.169917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:11.170638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:11.170978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:11.171310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:11.172088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:11.172451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:11.173927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:11.180181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 460/919] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:11.186222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:11.280994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:11.292506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88cb1-c708-49fe-98d8-5658cc5f10fe None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:11.336086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a446-e95f-493a-bd47-aa38a928e4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:11.336742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a446-e95f-493a-bd47-aa38a928e4ad None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:11.336979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a446-e95f-493a-bd47-aa38a928e4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:11.337261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a446-e95f-493a-bd47-aa38a928e4ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:11.337988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a446-e95f-493a-bd47-aa38a928e4ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:11.339366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a446-e95f-493a-bd47-aa38a928e4ad None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:11.367231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 460/920] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:01:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:01:11.405292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a78a0f-5b8d-4570-8396-011fcbad3a1c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:11.454550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:11.455195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:11.455477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:11.455799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:11.456389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:11.457860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:11.467562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:11.468784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:11.469854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 461/921] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:11.477034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a446-e95f-493a-bd47-aa38a928e4ad None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:11.519556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:11.606449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a446-e95f-493a-bd47-aa38a928e4ad None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:11.643886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:11.644865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:11.645361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:11.645997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:11.646827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:11.647324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:11.648910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:11.659533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 461/922] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:11.661646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:11.674439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:11.769072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746cd48-1d9a-4655-8575-9c3f52adc7c5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:11.804459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac58642-d4e5-46e4-814b-5e1cd1063d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:11.805065 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58642-d4e5-46e4-814b-5e1cd1063d49 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:11.805342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58642-d4e5-46e4-814b-5e1cd1063d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:11.805645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58642-d4e5-46e4-814b-5e1cd1063d49 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:11.806279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac58642-d4e5-46e4-814b-5e1cd1063d49 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:11.806580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac58642-d4e5-46e4-814b-5e1cd1063d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:11.807947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac58642-d4e5-46e4-814b-5e1cd1063d49 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:11.817513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 462/923] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Sep 8 01:01:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:11.819673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:11.922001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:11.936050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b40c3-eb4f-430f-8274-33e8769a259a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:11.971527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afed632-681c-48e9-8d0e-f72045627594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:11.972148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed632-681c-48e9-8d0e-f72045627594 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:11.972431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed632-681c-48e9-8d0e-f72045627594 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:11.972706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afed632-681c-48e9-8d0e-f72045627594 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:11.973420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afed632-681c-48e9-8d0e-f72045627594 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:11.974831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afed632-681c-48e9-8d0e-f72045627594 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:12.000523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 462/924] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:01:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:01:13.141546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953bb61-269f-4425-a552-3b84c09b3710 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.142058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953bb61-269f-4425-a552-3b84c09b3710 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.142134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953bb61-269f-4425-a552-3b84c09b3710 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.143728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 463/925] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:13.149233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d4ab1-76a2-41e8-9923-35e27394edde None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.149685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d4ab1-76a2-41e8-9923-35e27394edde None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.149874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d4ab1-76a2-41e8-9923-35e27394edde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.170214 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-543d4ab1-76a2-41e8-9923-35e27394edde None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:13.171440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-543d4ab1-76a2-41e8-9923-35e27394edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:13.251322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 463/926] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:13.300331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d652bc4-ff0c-4d3f-bc8f-12c52740c1fe None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.300657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d652bc4-ff0c-4d3f-bc8f-12c52740c1fe None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.300886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d652bc4-ff0c-4d3f-bc8f-12c52740c1fe None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.302474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 464/927] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:13.307419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d612-8fda-4ef8-9cb5-5327e666eada None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.307790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d612-8fda-4ef8-9cb5-5327e666eada None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.308071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d612-8fda-4ef8-9cb5-5327e666eada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.327056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3298d612-8fda-4ef8-9cb5-5327e666eada None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:13.328294 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3298d612-8fda-4ef8-9cb5-5327e666eada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:13.397602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:13.402564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 464/928] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:13.543007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d652bc4-ff0c-4d3f-bc8f-12c52740c1fe None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:13.617458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0a8c9-d340-4318-bee5-b4c0be50f6d1 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.617898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0a8c9-d340-4318-bee5-b4c0be50f6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.618274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0a8c9-d340-4318-bee5-b4c0be50f6d1 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.620025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 465/929] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:13.620421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:13.626085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8108b8e-6d62-41a5-9340-82ec30d3248c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.626375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8108b8e-6d62-41a5-9340-82ec30d3248c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.626655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8108b8e-6d62-41a5-9340-82ec30d3248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.650303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e8108b8e-6d62-41a5-9340-82ec30d3248c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:13.651817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e8108b8e-6d62-41a5-9340-82ec30d3248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:13.664435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d652bc4-ff0c-4d3f-bc8f-12c52740c1fe None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:13.704937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:13.706023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.706520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.706916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.707857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:13.709248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:13.719959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:13.720950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:13.721796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:13.725550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 465/930] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:13.726672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:13.732487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 466/931] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:13.732621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8108b8e-6d62-41a5-9340-82ec30d3248c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:13.839640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840a00c-0374-4e81-a561-c6f41948f815 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:13.858787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8108b8e-6d62-41a5-9340-82ec30d3248c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:13.873022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:13.879492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd285e-ce34-47ff-8dc1-802ddb9d015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:13.880492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd285e-ce34-47ff-8dc1-802ddb9d015e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.880901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd285e-ce34-47ff-8dc1-802ddb9d015e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.881330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd285e-ce34-47ff-8dc1-802ddb9d015e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.893490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd285e-ce34-47ff-8dc1-802ddb9d015e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:13.894743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-06bd285e-ce34-47ff-8dc1-802ddb9d015e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:13.899565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:13.900782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:13.901727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:13.902805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:13.902805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:13.902805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:13.902805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:13.903192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 466/932] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 8 01:01:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:13.905975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:13.906290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:13.907679 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:13.908233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd285e-ce34-47ff-8dc1-802ddb9d015e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:13.913078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 467/933] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:13.924014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.035313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd285e-ce34-47ff-8dc1-802ddb9d015e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.058851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c355d7-46da-4831-8f7a-e6fc73f702c4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.079454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.080074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.080358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.080634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.081440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:14.081754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.083129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.092162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 467/934] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 8 01:01:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:14.092984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.103973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.104920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.105460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.105968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.107319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:14.107832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.109396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.116702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 468/935] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:14.118049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.173751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:14.189265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:14.234298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdfbd5-06dd-490b-b5d8-a5c20888ca64 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.236538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49d78-d83b-4120-b380-82c5b862b75c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.272628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.273078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e1257-de42-4c49-a4f5-5772c8044597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.273262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.273683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.273792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1257-de42-4c49-a4f5-5772c8044597 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.274005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1257-de42-4c49-a4f5-5772c8044597 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.274108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.274278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1257-de42-4c49-a4f5-5772c8044597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.274753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.276205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.285476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e1257-de42-4c49-a4f5-5772c8044597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:14.285722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:14.286850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:14.287664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:14.288382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e1257-de42-4c49-a4f5-5772c8044597 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.288466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 468/936] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:14.288466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7d0e1257-de42-4c49-a4f5-5772c8044597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:14.304130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:14.305145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:14.306046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:14.306046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:14.306046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:14.306046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 469/937] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:14.306811 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68ac7-497f-41eb-882c-4e4476b85dfd None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.306811 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68ac7-497f-41eb-882c-4e4476b85dfd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.307082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68ac7-497f-41eb-882c-4e4476b85dfd None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.308442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 470/938] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:14.309045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f68ac7-497f-41eb-882c-4e4476b85dfd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.399112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f60f1a-4b12-4982-9c59-048a14903daa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.415351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f68ac7-497f-41eb-882c-4e4476b85dfd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.419379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:14.425981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:14.438369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.438989 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.439269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.439541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.440835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] RBAC: Adding query filter params (interface=public, service_id=42d578c57b6943b6ac0228bf1bbc9649, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:14.441384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.443438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.451539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5c352-4856-40ed-ae98-1ae1c70f9c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.452222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5c352-4856-40ed-ae98-1ae1c70f9c52 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.452508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5c352-4856-40ed-ae98-1ae1c70f9c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.452777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5c352-4856-40ed-ae98-1ae1c70f9c52 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.453413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5c352-4856-40ed-ae98-1ae1c70f9c52 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:14.453546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 469/939] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/endpoints?service_id=42d578c57b6943b6ac0228bf1bbc9649&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:14.453740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5c352-4856-40ed-ae98-1ae1c70f9c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.454266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.455102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5c352-4856-40ed-ae98-1ae1c70f9c52 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.464481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 471/940] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:14.464481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46f6e0-e002-4f0c-8e97-8277acf8ac2b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.464481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46f6e0-e002-4f0c-8e97-8277acf8ac2b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.464481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46f6e0-e002-4f0c-8e97-8277acf8ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.479491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2b46f6e0-e002-4f0c-8e97-8277acf8ac2b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:14.480715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2b46f6e0-e002-4f0c-8e97-8277acf8ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:14.555993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 472/941] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:14.556921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46f6e0-e002-4f0c-8e97-8277acf8ac2b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.571597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c29462-3e90-413a-a1ce-bc1619107a1f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.608766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.609689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.610123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.610549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.611348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:14.611715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.613091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.633364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 470/942] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:14.633364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.674131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46f6e0-e002-4f0c-8e97-8277acf8ac2b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.676486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:14.682549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:14.710404 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2afdf-a324-429b-82dc-e0c5ff249740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.711014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2afdf-a324-429b-82dc-e0c5ff249740 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.711305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2afdf-a324-429b-82dc-e0c5ff249740 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.711580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2afdf-a324-429b-82dc-e0c5ff249740 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.712194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2afdf-a324-429b-82dc-e0c5ff249740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.713692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2afdf-a324-429b-82dc-e0c5ff249740 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.720266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 473/943] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:01:14.720266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2afdf-a324-429b-82dc-e0c5ff249740 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.758684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bea11-7958-45fe-a7e6-22f39731a628 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.799545 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.800300 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.800650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.801087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.801955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:14.802270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.803664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.809632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 471/944] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:14.835931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.854997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2afdf-a324-429b-82dc-e0c5ff249740 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.900775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:14.901588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:14.902006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:14.902351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:14.912461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:14.914110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:14.930829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:14.932051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:01:14.933166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:14.937850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 474/945] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:14.940363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:14.974445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b25a-5ca3-47cc-be3b-55f1e5c47d09 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:14.976220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:14.988009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:15.025973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:15.026885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:15.027000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:15.027217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:15.027856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:15.029478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:15.032836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING keystone.server.flask.common [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 01:01:15.055772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.sql.core [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 01:01:15.055772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 01:01:15.055772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [parameters: {'id': '8706082bb8bb4bf5b8b8ae4c9c833ead', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 01:01:15.055772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81676) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8706082bb8bb4bf5b8b8ae4c9c833ead.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8706082bb8bb4bf5b8b8ae4c9c833ead. Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 01:01:15.063879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 08 01:01:15.064718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application yield resource Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise self.value Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application session.commit() Sep 08 01:01:15.065751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.flush() Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application compat.raise_( Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 01:01:15.066641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 01:01:15.067513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 01:01:15.068317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [parameters: {'id': '8706082bb8bb4bf5b8b8ae4c9c833ead', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:15.069161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:15.071811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8706082bb8bb4bf5b8b8ae4c9c833ead. Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 472/946] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Sep 8 01:01:14 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:15.073947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:15.084381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c4212-cca2-4d86-8bc3-c544204bb07e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:15.130829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:15.132000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:15.132379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:15.132716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:15.133465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:15.133777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:15.135594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:15.157096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 475/947] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 8 01:01:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:15.166426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:15.197705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cf39-957c-4c11-8d2f-ec4f5c319ffe None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:15.234260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:15.234896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:15.235175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:15.235445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:15.242878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:15.244590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:15.257129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:15.258093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.258958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 473/948] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:15.264669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:15.295231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:15.297755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:15.323772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b510-ed19-45c5-90ff-4d6849db295b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:15.369452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:15.370107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:15.370386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:15.370708 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:15.383106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:15.384564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:15.392774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6e7c-eb3b-4f23-a0ab-08a50ce53a7f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:15.402043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:15.403235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:15.404744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:15.404744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:15.404744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:15.408932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 476/949] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:15.409860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:15.436656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:15.437755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:15.438238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:15.438779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:15.439638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:15.440123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:15.442175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:15.469538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 474/950] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:01:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:15.523579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea385bba-1fb4-4625-ac44-6c91c1f41f72 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:15.562981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:15.563610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:15.563892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:15.564168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:15.564828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:15.565130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:15.566551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:15.574727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:15.585801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 477/951] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:15.587618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:15.683928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:15.704558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a4b27-9d18-4d47-b089-d01b141ac2b4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:15.743998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:15.744573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:15.744841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:15.745109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:15.752110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:15.753631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:15.765844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:15.766720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:15.767784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 475/952] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:15.772685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:15.876667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58c3f1-e2c5-42d0-bd6d-e0ec41ab5289 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:15.911205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2461fc-5a52-46a1-af60-f7f15b2fc2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:15.911806 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2461fc-5a52-46a1-af60-f7f15b2fc2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:15.912082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2461fc-5a52-46a1-af60-f7f15b2fc2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:15.912350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2461fc-5a52-46a1-af60-f7f15b2fc2d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:15.913029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2461fc-5a52-46a1-af60-f7f15b2fc2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:15.913327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2461fc-5a52-46a1-af60-f7f15b2fc2d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:15.914815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2461fc-5a52-46a1-af60-f7f15b2fc2d9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:15.927043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 478/953] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:15.935526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:16.039775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c3c93-370c-4359-8a11-dd2f90d0926d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:16.076432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c589c09-5bf4-4f72-970e-a9dea827f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:16.077184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589c09-5bf4-4f72-970e-a9dea827f117 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:16.077571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589c09-5bf4-4f72-970e-a9dea827f117 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:16.077906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589c09-5bf4-4f72-970e-a9dea827f117 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/912d86eef7b64c0a8b260ae7a804991d/roles/27f2eddc8e8843c79e44d0a15aec14ca` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:16.080220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c589c09-5bf4-4f72-970e-a9dea827f117 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=912d86eef7b64c0a8b260ae7a804991d, role_id=27f2eddc8e8843c79e44d0a15aec14ca)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:16.081735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c589c09-5bf4-4f72-970e-a9dea827f117 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:16.099250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 476/954] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:01:15 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/912d86eef7b64c0a8b260ae7a804991d/roles/27f2eddc8e8843c79e44d0a15aec14ca => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:01:17.014630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e357810-a76f-4df1-83c7-50b0afe8a849 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.015155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e357810-a76f-4df1-83c7-50b0afe8a849 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.015155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e357810-a76f-4df1-83c7-50b0afe8a849 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.016852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 479/955] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:17.022752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f4a7-af36-4905-a44d-754dee941207 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.023228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f4a7-af36-4905-a44d-754dee941207 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.023319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f4a7-af36-4905-a44d-754dee941207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.030018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:17.044893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3469f4a7-af36-4905-a44d-754dee941207 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:17.046611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3469f4a7-af36-4905-a44d-754dee941207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:17.125537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 477/956] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:17.196912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f983c-acd5-4414-8503-955c882930a5 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.197250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f983c-acd5-4414-8503-955c882930a5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.197486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f983c-acd5-4414-8503-955c882930a5 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.198959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 480/957] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:17.204810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c997-bfec-4ed0-a2ae-c1b0f0b7c005 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.205100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c997-bfec-4ed0-a2ae-c1b0f0b7c005 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.205368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c997-bfec-4ed0-a2ae-c1b0f0b7c005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.223961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4db5c997-bfec-4ed0-a2ae-c1b0f0b7c005 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:17.225174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4db5c997-bfec-4ed0-a2ae-c1b0f0b7c005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:17.292780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 478/958] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:17.461544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f983c-acd5-4414-8503-955c882930a5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:17.551429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:17.596627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f983c-acd5-4414-8503-955c882930a5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:17.630820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:17.631450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.631726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.631996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.632577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:17.634046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:17.643251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:17.644314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:17.645162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 481/959] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:17.650704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5c997-bfec-4ed0-a2ae-c1b0f0b7c005 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:17.661765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:17.722324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:17.768109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5c997-bfec-4ed0-a2ae-c1b0f0b7c005 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:17.789181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519197a7-47db-4e51-a552-4650b45b1001 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:17.809722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c330e5-7f37-4e3a-8201-139c8b4eb5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:17.810407 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c330e5-7f37-4e3a-8201-139c8b4eb5bd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.810683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c330e5-7f37-4e3a-8201-139c8b4eb5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.810998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c330e5-7f37-4e3a-8201-139c8b4eb5bd None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.811633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c330e5-7f37-4e3a-8201-139c8b4eb5bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:17.812209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c330e5-7f37-4e3a-8201-139c8b4eb5bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:17.813413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c330e5-7f37-4e3a-8201-139c8b4eb5bd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:17.822324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 479/960] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:17.824115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026c716-436d-4888-9e03-fdc1c15fa21e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.824291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:17.824439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026c716-436d-4888-9e03-fdc1c15fa21e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.824649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026c716-436d-4888-9e03-fdc1c15fa21e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.830505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 480/961] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:17.831286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026c716-436d-4888-9e03-fdc1c15fa21e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:17.832661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721047d-ce02-436d-9dbd-ccf4b7d871eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:17.833269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721047d-ce02-436d-9dbd-ccf4b7d871eb None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.833580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721047d-ce02-436d-9dbd-ccf4b7d871eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.833982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721047d-ce02-436d-9dbd-ccf4b7d871eb None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.834631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721047d-ce02-436d-9dbd-ccf4b7d871eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:17.835988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721047d-ce02-436d-9dbd-ccf4b7d871eb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:17.852407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 482/962] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:01:17 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:01:17.859379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e464a-d567-45fb-a7d9-c5e5b8eecff7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:17.860151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e464a-d567-45fb-a7d9-c5e5b8eecff7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:17.860602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e464a-d567-45fb-a7d9-c5e5b8eecff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:17.888332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-414e464a-d567-45fb-a7d9-c5e5b8eecff7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:17.890937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-414e464a-d567-45fb-a7d9-c5e5b8eecff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:17.962123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026c716-436d-4888-9e03-fdc1c15fa21e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:17.990897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:18.002258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 483/963] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:18.008168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:18.009152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:18.009684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:18.010160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:18.011002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:18.011507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:18.014018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:18.024907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 481/964] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:18.026372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e464a-d567-45fb-a7d9-c5e5b8eecff7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:18.129805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e464a-d567-45fb-a7d9-c5e5b8eecff7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:18.143855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:18.166598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b31ff-ed23-4eb5-94a7-0d76dba64ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:18.167726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b31ff-ed23-4eb5-94a7-0d76dba64ff8 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:18.168481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b31ff-ed23-4eb5-94a7-0d76dba64ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:18.168753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b31ff-ed23-4eb5-94a7-0d76dba64ff8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:18.169572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b31ff-ed23-4eb5-94a7-0d76dba64ff8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:18.170954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b31ff-ed23-4eb5-94a7-0d76dba64ff8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:18.192879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 484/965] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:01:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:01:18.286108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:18.340349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98530408-ea8a-46d8-a768-d2857c822e0b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:18.340638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98530408-ea8a-46d8-a768-d2857c822e0b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:18.341477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98530408-ea8a-46d8-a768-d2857c822e0b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:18.342856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 485/966] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:18.353728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38854f-ec45-4cb0-8750-be08ee96e17b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:18.355144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38854f-ec45-4cb0-8750-be08ee96e17b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:18.355792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38854f-ec45-4cb0-8750-be08ee96e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:18.382326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6b38854f-ec45-4cb0-8750-be08ee96e17b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:18.382695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6b38854f-ec45-4cb0-8750-be08ee96e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:18.423332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e5c2-bacf-4aa2-b80c-520acd9029ed None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:18.472731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:18.473445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:18.473810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:18.474430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:18.475268 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:18.477006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:18.493436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 486/967] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:18.499357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.sql.core [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 01:01:18.499357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 01:01:18.499357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [parameters: {'user_id': '035eadad7c8f49acb4d0f4429a593e58', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 01:01:18.499357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81676) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Sep 08 01:01:18.507011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 01:01:18.507879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application yield resource Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise self.value Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application session.commit() Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 01:01:18.509217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.flush() Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application compat.raise_( Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 01:01:18.510367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 01:01:18.511248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 01:01:18.512583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [parameters: {'user_id': '035eadad7c8f49acb4d0f4429a593e58', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:18.516058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 08 01:01:18.518022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 08 01:01:18.526601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 08 01:01:18.526601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 08 01:01:18.526601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 01:01:18.526601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 01:01:18.526601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 01:01:18.526601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:18.526601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 482/968] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Sep 8 01:01:18 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:18.527612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38854f-ec45-4cb0-8750-be08ee96e17b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:18.620039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:18.625991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38854f-ec45-4cb0-8750-be08ee96e17b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:18.664079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:18.664674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:18.664960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:18.665235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:18.675069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:18.677490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:18.694512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:18.695484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:18.696837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 487/969] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:01:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:18.703231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:18.768347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:18.791998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:18.838597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b9df-a5cf-413b-9d78-cbe62f8636b9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:18.875679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:18.876633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:18.877133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:18.877640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:18.878544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:18.879039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:18.880853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:18.912758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1a40-88e6-4646-8eb0-50ae2e46d612 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:18.920164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 483/970] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Sep 8 01:01:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:18.959270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e79bf-f1f6-47b1-8657-141a6eafefa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:18.960318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e79bf-f1f6-47b1-8657-141a6eafefa8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:18.960810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e79bf-f1f6-47b1-8657-141a6eafefa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:18.961295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e79bf-f1f6-47b1-8657-141a6eafefa8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:18.974302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e79bf-f1f6-47b1-8657-141a6eafefa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-405e79bf-f1f6-47b1-8657-141a6eafefa8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:18.980102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:18.981089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:18.982166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:18.989503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 488/971] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 8 01:01:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:18.991187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:19.111710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91abb48-fc99-4a50-bad5-d8c7e9b9c53a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:19.113382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:19.151192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:19.151863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:19.152330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:19.152605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:19.153869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:19.154208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:19.155673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:19.165333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 484/972] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 8 01:01:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:19.171354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e79bf-f1f6-47b1-8657-141a6eafefa8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:19.195489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:19.281596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e79bf-f1f6-47b1-8657-141a6eafefa8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:19.320595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:19.321227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:19.321541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:19.321818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:19.332907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:19.334370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:19.348914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:19.349859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:19.356852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:19.356852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:19.356852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:19.356852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 489/973] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:19.358580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:19.463287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caac65-001e-424c-8575-c5990dcf7250 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:19.498445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:19.499276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:19.499563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:19.499889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:19.500539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:19.500839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:19.502236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:19.518431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 485/974] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:19.524151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:19.596013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:19.628242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a46f56-c444-415e-9bde-c530236854cc None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:19.661912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:19.662536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:19.662814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:19.663084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:19.671883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:19.673314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:19.684232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:19.685702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:19.686607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 490/975] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:01:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:19.693351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:19.720336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:19.798695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129d889-03c7-4d96-b195-6f59efa35a38 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:19.833778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78153f-67e3-4df9-af2c-6e6db94ea688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:19.834434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78153f-67e3-4df9-af2c-6e6db94ea688 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:19.834721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78153f-67e3-4df9-af2c-6e6db94ea688 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:19.834994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78153f-67e3-4df9-af2c-6e6db94ea688 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:19.835719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78153f-67e3-4df9-af2c-6e6db94ea688 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:19.836024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78153f-67e3-4df9-af2c-6e6db94ea688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:19.837457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78153f-67e3-4df9-af2c-6e6db94ea688 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:19.860954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 486/976] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Sep 8 01:01:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:19.862586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:19.965654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9c16-1fd1-4522-a76a-142841d1977a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:19.998295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:20.005738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84f5a-a9be-4fbd-9b24-2970f73c010b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:20.006356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84f5a-a9be-4fbd-9b24-2970f73c010b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.006640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84f5a-a9be-4fbd-9b24-2970f73c010b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.006910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f84f5a-a9be-4fbd-9b24-2970f73c010b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.080020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f84f5a-a9be-4fbd-9b24-2970f73c010b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:20.081804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f84f5a-a9be-4fbd-9b24-2970f73c010b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:20.087272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30e54-9855-4a1d-aa75-a529ee40a1c7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.087557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30e54-9855-4a1d-aa75-a529ee40a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.087828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30e54-9855-4a1d-aa75-a529ee40a1c7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.089392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 487/977] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:20.094833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84182-79a0-4816-9c1d-da7f428a85ef None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.095122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84182-79a0-4816-9c1d-da7f428a85ef None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.095395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84182-79a0-4816-9c1d-da7f428a85ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.114040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-64f84182-79a0-4816-9c1d-da7f428a85ef None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:20.115550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-64f84182-79a0-4816-9c1d-da7f428a85ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:20.191455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 491/978] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:19 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 01:01:20.191998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 488/979] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:20.193583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84f5a-a9be-4fbd-9b24-2970f73c010b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.223321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:20.295415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f84f5a-a9be-4fbd-9b24-2970f73c010b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:20.332448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ba5ce-7b64-49c6-87b7-0c0660c6869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:20.333090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ba5ce-7b64-49c6-87b7-0c0660c6869e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.333365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ba5ce-7b64-49c6-87b7-0c0660c6869e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.333670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ba5ce-7b64-49c6-87b7-0c0660c6869e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.344456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ba5ce-7b64-49c6-87b7-0c0660c6869e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:20.345922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ba5ce-7b64-49c6-87b7-0c0660c6869e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-958ba5ce-7b64-49c6-87b7-0c0660c6869e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:20.361314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:20.362289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:20.363182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:20.363182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:20.363182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:20.365746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 492/980] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:20.368292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84182-79a0-4816-9c1d-da7f428a85ef None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.383967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:20.425478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc006df-5378-47bf-96e4-345e5e6f5816 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.425770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc006df-5378-47bf-96e4-345e5e6f5816 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.426051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc006df-5378-47bf-96e4-345e5e6f5816 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.427515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 493/981] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:20.432191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5784-b9ae-4bf0-a5ed-77057b2ee049 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.432477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5784-b9ae-4bf0-a5ed-77057b2ee049 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.432754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5784-b9ae-4bf0-a5ed-77057b2ee049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.451048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1ecd5784-b9ae-4bf0-a5ed-77057b2ee049 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:20.452227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1ecd5784-b9ae-4bf0-a5ed-77057b2ee049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:20.476203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84182-79a0-4816-9c1d-da7f428a85ef None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:20.512363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:20.512976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.513249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.513812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.514453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:20.514750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:20.516113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:20.523289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 494/982] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:20.524145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5784-b9ae-4bf0-a5ed-77057b2ee049 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.532336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 489/983] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:20.534316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.539495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:20.615227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:20.628261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5784-b9ae-4bf0-a5ed-77057b2ee049 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:20.652126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca1f47-1798-47fa-899e-2ca280f4ac8c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:20.665938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:20.666577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.666861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.667139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.667758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:20.669212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:20.678360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:20.679339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:20.680816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 495/984] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:20.685682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.692076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:20.692953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.693464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.693933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.700858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:20.702588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:20.714754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:20.715601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:20.716975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:20.716975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:20.716975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:20.716975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:20.716975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:20.716975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:20.716975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:20.716975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:20.724138 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 490/985] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:20.724627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.768835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:20.796739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbe81-bb3c-4395-9eee-1c9a4bbb0965 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:20.830114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:20.830527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c136e-89cb-4953-8631-05dccab7842f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:20.830720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.831000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.831272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.831894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:20.832196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:20.833590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:20.838407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 496/986] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:20.839183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.863974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:20.870282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:20.870829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.871110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.871383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.872100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:20.872405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:20.873866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:20.885687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 491/987] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:20.886474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.937609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424db47-b3aa-4131-ba44-bd60f2d042ca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:20.971339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:20.971964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:20.972244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:20.972518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:20.973100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:20.974507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:20.983422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:20.984496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:20.985323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 497/988] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:20.986169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:20.991300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:20.992732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e0e43-fbb1-4aab-8438-420a6452c9cf None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:21.027539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:21.028146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:21.028480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:21.028754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:21.029381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:21.029712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:21.031072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:21.036229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 492/989] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:21.036887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:21.091326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da3c3-7678-42b7-992d-d67aa94d8071 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:21.091913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:21.125825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:21.126351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:21.126628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:21.126899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:21.127619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] RBAC: Adding query filter params (role.id=27f2eddc8e8843c79e44d0a15aec14ca, scope.project.id=454105f786874ed1b407da41aef24389, user.id=912d86eef7b64c0a8b260ae7a804991d) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:21.127923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:21.129330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:21.135108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 498/990] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:20 2022] GET /identity/v3/role_assignments?user.id=912d86eef7b64c0a8b260ae7a804991d&scope.project.id=454105f786874ed1b407da41aef24389&role.id=27f2eddc8e8843c79e44d0a15aec14ca => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:21.135844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30e6a2-eced-4940-8aba-dcb474d73284 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:21.136275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:21.178217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:21.178841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:21.179125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:21.179398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:21.180038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:21.180372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:21.181785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:21.187598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 493/991] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:21.193812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:21.231387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:21.270028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44634a90-bbfa-46b5-93a4-89f7b91a1b55 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:21.308314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:21.308949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:21.309230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:21.309568 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:21.310270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] RBAC: Adding query filter params (interface=public, service_id=2adf94e3a3894c8386eccb4d21ffa206, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:21.310573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:21.311936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:21.319562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 499/992] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 8 01:01:21 2022] GET /identity/v3/endpoints?service_id=2adf94e3a3894c8386eccb4d21ffa206&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:21.321327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc048-9945-4250-9de8-d8de2ca7a7c0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:21.326282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:21.343481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:21.362093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:21.362712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:21.362995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:21.363274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:21.363908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:21.364223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:21.365703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:21.371023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 494/993] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:21.376672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:21.442281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d03a-f5f0-4a9e-b432-d66a2ad8dea2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:21.475681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:21.477878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9541c-028d-4b7d-ae7f-9c9c8158bdac None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:21.482610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4a670-2a2c-4adb-b1b1-866322cdb9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:21.483410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a670-2a2c-4adb-b1b1-866322cdb9da None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:21.483863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a670-2a2c-4adb-b1b1-866322cdb9da None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:21.484292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4a670-2a2c-4adb-b1b1-866322cdb9da None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:21.485151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4a670-2a2c-4adb-b1b1-866322cdb9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:21.487193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4a670-2a2c-4adb-b1b1-866322cdb9da None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:21.505707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 500/994] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:01:21 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:01:21.528691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816fe56-ea71-4e50-9103-2cae784b3a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:21.529365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fe56-ea71-4e50-9103-2cae784b3a78 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:21.529680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fe56-ea71-4e50-9103-2cae784b3a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:21.529952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fe56-ea71-4e50-9103-2cae784b3a78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:21.530726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816fe56-ea71-4e50-9103-2cae784b3a78 None admin] RBAC: Adding query filter params (interface=admin, service_id=42d578c57b6943b6ac0228bf1bbc9649, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:21.531036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816fe56-ea71-4e50-9103-2cae784b3a78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:21.532444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816fe56-ea71-4e50-9103-2cae784b3a78 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:21.538343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 495/995] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Sep 8 01:01:21 2022] GET /identity/v3/endpoints?service_id=42d578c57b6943b6ac0228bf1bbc9649&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:21.544751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4a670-2a2c-4adb-b1b1-866322cdb9da None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:21.656038 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4a670-2a2c-4adb-b1b1-866322cdb9da None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:21.693023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40dd0b-ef21-4499-bd93-59abff43cbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:21.693667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40dd0b-ef21-4499-bd93-59abff43cbdc None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:21.693953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40dd0b-ef21-4499-bd93-59abff43cbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:21.694228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40dd0b-ef21-4499-bd93-59abff43cbdc None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:21.694835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40dd0b-ef21-4499-bd93-59abff43cbdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:21.696204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40dd0b-ef21-4499-bd93-59abff43cbdc None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:21.702659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 501/996] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:01:21 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:01:23.304838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7acc-4b7d-40e2-ba51-68e2eeae25bb None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:23.305371 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7acc-4b7d-40e2-ba51-68e2eeae25bb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:23.305371 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7acc-4b7d-40e2-ba51-68e2eeae25bb None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:23.306786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 496/997] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:23.312407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7dd98-f522-402b-84c8-132cf0e894ab None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:23.312787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7dd98-f522-402b-84c8-132cf0e894ab None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:23.312960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7dd98-f522-402b-84c8-132cf0e894ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:23.330928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fdf7dd98-f522-402b-84c8-132cf0e894ab None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:23.332114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fdf7dd98-f522-402b-84c8-132cf0e894ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:23.390232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:23.406276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 502/998] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:23.641949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c34033-c988-42a9-b709-ac4108b438bc None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:23.642277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c34033-c988-42a9-b709-ac4108b438bc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:23.642501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c34033-c988-42a9-b709-ac4108b438bc None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:23.643987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 497/999] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:23.649030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f12af-1bc7-4423-9022-2f883d8cc368 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:23.649316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f12af-1bc7-4423-9022-2f883d8cc368 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:23.649619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f12af-1bc7-4423-9022-2f883d8cc368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:23.667411 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7a4f12af-1bc7-4423-9022-2f883d8cc368 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:23.668582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7a4f12af-1bc7-4423-9022-2f883d8cc368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:23.670386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c34033-c988-42a9-b709-ac4108b438bc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:23.728204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:23.743510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 503/1000] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:23.787510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c34033-c988-42a9-b709-ac4108b438bc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:23.822702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7847a8-fafe-4f17-81ce-58775691d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:23.823325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7847a8-fafe-4f17-81ce-58775691d929 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:23.823601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7847a8-fafe-4f17-81ce-58775691d929 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:23.823872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7847a8-fafe-4f17-81ce-58775691d929 None admin] PATH_INFO: `/v3/services/image` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:23.824444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7847a8-fafe-4f17-81ce-58775691d929 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:23.825860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7847a8-fafe-4f17-81ce-58775691d929 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cb7847a8-fafe-4f17-81ce-58775691d929 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:23.834726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:23.835697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:23.836667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:23.840701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 498/1001] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Sep 8 01:01:23 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:23.845622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f12af-1bc7-4423-9022-2f883d8cc368 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:23.868018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499f7f-c669-498b-b9a3-4247da703240 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:23.868377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499f7f-c669-498b-b9a3-4247da703240 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:23.868598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499f7f-c669-498b-b9a3-4247da703240 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:23.870078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 499/1002] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:23.875273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dd2e8-9356-4c23-bc60-34f08f92bb0e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:23.875557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dd2e8-9356-4c23-bc60-34f08f92bb0e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:23.875933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dd2e8-9356-4c23-bc60-34f08f92bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:23.894019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f02dd2e8-9356-4c23-bc60-34f08f92bb0e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:23.895132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f02dd2e8-9356-4c23-bc60-34f08f92bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:23.947865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f12af-1bc7-4423-9022-2f883d8cc368 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:23.965204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 500/1003] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:23.968347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:23.984493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:23.985176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:23.985560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:23.985903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:23.986601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] RBAC: Adding query filter params (name=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:23.986978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:23.988406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:23.998038 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 504/1004] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:23.999087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dd2e8-9356-4c23-bc60-34f08f92bb0e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.015855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.046832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:24.115601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dd2e8-9356-4c23-bc60-34f08f92bb0e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.129375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c8ed-d63c-4e43-bac7-d4b60b2b7c1e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.150882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.151423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.151701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.151976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.152599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] RBAC: Adding query filter params (type=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:24.152894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.154798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.159345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 501/1005] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:24.167967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.168882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.169781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.170153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.170856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.172397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:24.182777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:24.184026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 01:01:24.185146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:24.189520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 505/1006] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:24.193114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.236389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.290728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:24.315083 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef926da-5d8c-4c91-b49a-9a26a6d9d152 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.323503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:24.355264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.355643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b345ad0-f873-410a-b4ae-9676aa184153 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.356062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.356138 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.356467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.357090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:24.357398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.358790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.365450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 502/1007] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:01:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:24.369345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.394415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.395041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.395316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.395590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.396167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.397575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:24.407872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:24.408838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:24.410298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 506/1008] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Sep 8 01:01:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:24.415036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.476597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a20ac-df86-4ec0-8a3d-d2208fae6765 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.515684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.516379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.516726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.517063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.517793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:24.518160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.519579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.524889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 503/1009] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Sep 8 01:01:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:24.525135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f32656-3605-44a5-9163-269c2f97e47c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.530318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.539605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:24.564508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.565223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.565457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.565735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.566355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:24.566707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.567382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:24.569021 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.574376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 507/1010] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:24.580885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.635520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0446-1bd6-4ec6-a4ee-cf1dd999f75d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.676540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef9c7-923c-40d5-885a-34fc37bdfc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.677063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef9c7-923c-40d5-885a-34fc37bdfc1a None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.677330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef9c7-923c-40d5-885a-34fc37bdfc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.677632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef9c7-923c-40d5-885a-34fc37bdfc1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.678292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfef9c7-923c-40d5-885a-34fc37bdfc1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.679650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfef9c7-923c-40d5-885a-34fc37bdfc1a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.692262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2dbce-3476-4a30-8136-37670af9571f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.713439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 504/1011] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:01:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:01:24.736735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1b00a-d7eb-4a2f-8d6c-24b351172d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.737357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b00a-d7eb-4a2f-8d6c-24b351172d6b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.737669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b00a-d7eb-4a2f-8d6c-24b351172d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.737940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1b00a-d7eb-4a2f-8d6c-24b351172d6b None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.738576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1b00a-d7eb-4a2f-8d6c-24b351172d6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:24.738877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1b00a-d7eb-4a2f-8d6c-24b351172d6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.740332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1b00a-d7eb-4a2f-8d6c-24b351172d6b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.751415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 508/1012] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Sep 8 01:01:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:24.753004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef9c7-923c-40d5-885a-34fc37bdfc1a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:24.852609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:24.865255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef9c7-923c-40d5-885a-34fc37bdfc1a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:24.901994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae4c0-cd76-4321-9005-3e16e08bd0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:24.902609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae4c0-cd76-4321-9005-3e16e08bd0a7 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:24.902884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae4c0-cd76-4321-9005-3e16e08bd0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:24.903757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae4c0-cd76-4321-9005-3e16e08bd0a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:24.904353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae4c0-cd76-4321-9005-3e16e08bd0a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:24.905742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae4c0-cd76-4321-9005-3e16e08bd0a7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:24.923214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 505/1013] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:01:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:01:26.412886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395970d9-add9-4ddc-81ad-04b0e0ea9c9b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:26.413596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395970d9-add9-4ddc-81ad-04b0e0ea9c9b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:26.413596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395970d9-add9-4ddc-81ad-04b0e0ea9c9b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:26.414947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 509/1014] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:26.420549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00adcab-ba4e-4c0f-9bfd-e4002de58379 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:26.420935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00adcab-ba4e-4c0f-9bfd-e4002de58379 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:26.421116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00adcab-ba4e-4c0f-9bfd-e4002de58379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:26.439154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a00adcab-ba4e-4c0f-9bfd-e4002de58379 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:26.440346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a00adcab-ba4e-4c0f-9bfd-e4002de58379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:26.517373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 506/1015] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:26 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:26.785305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395970d9-add9-4ddc-81ad-04b0e0ea9c9b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:26.824136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:26.897603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395970d9-add9-4ddc-81ad-04b0e0ea9c9b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:26.933153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1e5b0-04bd-4bd8-934a-3bff148ed3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:26.933822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e5b0-04bd-4bd8-934a-3bff148ed3ea None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:26.934106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e5b0-04bd-4bd8-934a-3bff148ed3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:26.934458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e5b0-04bd-4bd8-934a-3bff148ed3ea None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:26.935154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1e5b0-04bd-4bd8-934a-3bff148ed3ea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:26.936584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1e5b0-04bd-4bd8-934a-3bff148ed3ea None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:26.954618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 510/1016] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:01:26 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:01:27.059134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bbf5-5725-48f8-b5b0-a99753f75779 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.059447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bbf5-5725-48f8-b5b0-a99753f75779 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.059647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bbf5-5725-48f8-b5b0-a99753f75779 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.061227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 507/1017] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:27.066976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f41a5-d3d0-404f-9021-03284a2c8516 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.067271 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f41a5-d3d0-404f-9021-03284a2c8516 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.067545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f41a5-d3d0-404f-9021-03284a2c8516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.087379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b56f41a5-d3d0-404f-9021-03284a2c8516 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:27.088612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b56f41a5-d3d0-404f-9021-03284a2c8516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:27.092575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d4cf-1c04-445b-a7dc-8ad8d246d726 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.092855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d4cf-1c04-445b-a7dc-8ad8d246d726 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.093128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d4cf-1c04-445b-a7dc-8ad8d246d726 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.094656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 508/1018] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:27.100312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b8ac-8a86-4784-a611-476384c8b57c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.100636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b8ac-8a86-4784-a611-476384c8b57c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.100857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b8ac-8a86-4784-a611-476384c8b57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.119363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dd74b8ac-8a86-4784-a611-476384c8b57c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:27.120579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dd74b8ac-8a86-4784-a611-476384c8b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:27.174795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 511/1019] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:27.195909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 509/1020] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:27.441350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f41a5-d3d0-404f-9021-03284a2c8516 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:27.465095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:27.465373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b8ac-8a86-4784-a611-476384c8b57c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:27.475076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:27.554884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f41a5-d3d0-404f-9021-03284a2c8516 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:27.591846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7385a-4d29-4f8e-ba7e-bcfac9be3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:27.592498 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7385a-4d29-4f8e-ba7e-bcfac9be3089 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.592780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7385a-4d29-4f8e-ba7e-bcfac9be3089 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.593052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7385a-4d29-4f8e-ba7e-bcfac9be3089 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.593469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b8ac-8a86-4784-a611-476384c8b57c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:27.605416 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7385a-4d29-4f8e-ba7e-bcfac9be3089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-5cc7385a-4d29-4f8e-ba7e-bcfac9be3089 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:27.610355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:27.611264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:27.612670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 512/1021] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 8 01:01:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:27.617266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7385a-4d29-4f8e-ba7e-bcfac9be3089 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:27.631972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f290d-7615-4457-93c1-efbd50a98c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:27.632601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f290d-7615-4457-93c1-efbd50a98c3a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.632877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f290d-7615-4457-93c1-efbd50a98c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.633145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f290d-7615-4457-93c1-efbd50a98c3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.634294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f290d-7615-4457-93c1-efbd50a98c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:27.635717 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f290d-7615-4457-93c1-efbd50a98c3a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:27.637300 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 510/1022] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:27.643920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f290d-7615-4457-93c1-efbd50a98c3a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:27.710054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:27.722360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:27.729571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7385a-4d29-4f8e-ba7e-bcfac9be3089 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:27.750111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f290d-7615-4457-93c1-efbd50a98c3a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:27.767117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:27.768078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.768621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.769120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.770042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:27.770544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:27.772232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:27.781440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 513/1023] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 8 01:01:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:27.784913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726fab-3683-4b74-bddb-8105a2bd52d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:27.785549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726fab-3683-4b74-bddb-8105a2bd52d0 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.785919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726fab-3683-4b74-bddb-8105a2bd52d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.786113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726fab-3683-4b74-bddb-8105a2bd52d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.786747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b726fab-3683-4b74-bddb-8105a2bd52d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:27.787363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:27.788169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b726fab-3683-4b74-bddb-8105a2bd52d0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:27.815724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 511/1024] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:01:27 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:01:27.918974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2afb-6dea-4a9e-9630-a165983a04a7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:27.959007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:27.959731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:27.960020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:27.960352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:27.973140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:27.974722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:27.977995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:27.992976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:27.994041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:27.995431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:27.995431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:27.995431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:27.995431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 514/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:28.002633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726fab-3683-4b74-bddb-8105a2bd52d0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:28.123786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726fab-3683-4b74-bddb-8105a2bd52d0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:28.150227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:28.161968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:28.162578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:28.162855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:28.163126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:28.163771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:28.164073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:28.165446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:28.179265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 512/1026] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:28.186645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:28.308016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b12a6-42ea-45f5-a228-1998da16f032 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:28.342580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:28.343507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:28.343996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:28.344495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:28.352352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:28.354062 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:28.366031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:28.366961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:01:28.367911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:28.368938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 515/1027] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:01:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:28.374926 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:28.477387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ecdb6-f62d-4a82-aee5-92fbc4bca04c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:28.516686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:28.517300 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:28.517610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:28.517885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:28.518618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:28.518923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:28.520341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:28.543592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 513/1028] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:01:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:28.544954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:28.605013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:28.655233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f3cd9-e7bc-41ca-a7cb-e12935a14b0c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:28.690255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fabf4-b695-467c-82fa-138cd42a157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:28.690866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fabf4-b695-467c-82fa-138cd42a157d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:28.691149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fabf4-b695-467c-82fa-138cd42a157d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:28.691425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fabf4-b695-467c-82fa-138cd42a157d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:28.759833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fabf4-b695-467c-82fa-138cd42a157d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:28.761299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fabf4-b695-467c-82fa-138cd42a157d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:28.819887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:28.871975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 516/1029] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:01:28.873426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:28.922252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:28.977756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47621f1-f88a-4e29-8cd8-99806828ab42 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:29.012277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb3324-f80a-4b26-a6f2-43c7c8941f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:29.013525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb3324-f80a-4b26-a6f2-43c7c8941f47 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.014072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb3324-f80a-4b26-a6f2-43c7c8941f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.014345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb3324-f80a-4b26-a6f2-43c7c8941f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.026157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb3324-f80a-4b26-a6f2-43c7c8941f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:29.027741 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb3324-f80a-4b26-a6f2-43c7c8941f47 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4ebb3324-f80a-4b26-a6f2-43c7c8941f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:29.044948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:29.046220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:29.047093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:29.047093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:29.047093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:29.047093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 514/1030] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:29.053003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fabf4-b695-467c-82fa-138cd42a157d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:29.135392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2f75-e049-49db-bfbe-333f218dfd3c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.135740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2f75-e049-49db-bfbe-333f218dfd3c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.135960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2f75-e049-49db-bfbe-333f218dfd3c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.138102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 515/1031] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:29.142923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10aab-6d38-4d84-bdb6-6ad38baddb6c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.143203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10aab-6d38-4d84-bdb6-6ad38baddb6c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.143477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10aab-6d38-4d84-bdb6-6ad38baddb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.162618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fabf4-b695-467c-82fa-138cd42a157d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:29.163491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-04c10aab-6d38-4d84-bdb6-6ad38baddb6c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:29.164678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-04c10aab-6d38-4d84-bdb6-6ad38baddb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:29.198880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:29.199490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.199768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.201197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.201197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:29.201527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:29.202862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:29.216033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 517/1032] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:29.220916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:29.233970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 516/1033] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:29.242149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:29.326623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3b921-4f37-4ff4-a8bd-4fea0c08ada8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:29.360660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:29.361297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.361603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.361880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.368671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:29.370164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:29.382375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:29.383257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:29.389358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 518/1034] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:29.390145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c10aab-6d38-4d84-bdb6-6ad38baddb6c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:29.417329 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:29.494309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c10aab-6d38-4d84-bdb6-6ad38baddb6c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:29.510112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:29.531361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:29.531973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.532255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.532529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.533223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:29.533564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:29.534999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:29.549584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 517/1035] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:29.553433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:29.595222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:29.619008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39de65d-7476-4add-8bed-e09fb58be15f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:29.649513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:29.660119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:29.660762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.661070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.661351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.661945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:29.663321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:29.666731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead02fc-04b2-482b-b31d-819882dac5af None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:29.672194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:29.678116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:29.678982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 519/1036] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Sep 8 01:01:29 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:29.680114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:29.709338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:29.709979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.710260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.710533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.711259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] RBAC: Adding query filter params (role.id=27f2eddc8e8843c79e44d0a15aec14ca, scope.project.id=454105f786874ed1b407da41aef24389, user.id=1b9f7c644bde4c94a8cfe5ec13e782c3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:29.711567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:29.712984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:29.727239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 518/1037] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:29 2022] GET /identity/v3/role_assignments?user.id=1b9f7c644bde4c94a8cfe5ec13e782c3&scope.project.id=454105f786874ed1b407da41aef24389&role.id=27f2eddc8e8843c79e44d0a15aec14ca => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:29.794951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d9df6-ab12-40e4-93f0-418bcac0c7f5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:29.832301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:29.832924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.833209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.833515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.834165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] RBAC: Adding query filter params (name=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:29.834471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:29.835890 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:29.841370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 520/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:29.847303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:29.953988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e6580-7053-437e-a787-fb13c6d8133f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:29.991939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55931e-d6d1-4d3c-9878-2d68796fe056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:29.992568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55931e-d6d1-4d3c-9878-2d68796fe056 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:29.992848 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55931e-d6d1-4d3c-9878-2d68796fe056 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:29.993182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55931e-d6d1-4d3c-9878-2d68796fe056 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:29.993881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55931e-d6d1-4d3c-9878-2d68796fe056 None admin] RBAC: Adding query filter params (type=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:29.994188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55931e-d6d1-4d3c-9878-2d68796fe056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:29.995583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55931e-d6d1-4d3c-9878-2d68796fe056 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:30.006350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 519/1039] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:30.007584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:30.011466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:30.089237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd43a-1b7b-49ae-b228-062c3d311ed9 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:30.089601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd43a-1b7b-49ae-b228-062c3d311ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:30.089828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbd43a-1b7b-49ae-b228-062c3d311ed9 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:30.091369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 520/1040] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:30.096088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ed21-84f1-4774-9e1c-bc06772420c6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:30.096375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ed21-84f1-4774-9e1c-bc06772420c6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:30.096646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000ed21-84f1-4774-9e1c-bc06772420c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:30.114729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b0669-297d-44b1-96ef-a4644f19deaa None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:30.118794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4000ed21-84f1-4774-9e1c-bc06772420c6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:30.119984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4000ed21-84f1-4774-9e1c-bc06772420c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:30.130665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:30.151675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:30.152309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:30.152612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:30.152928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:30.154309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] RBAC: Adding query filter params (interface=public, service_id=396945eec91648279b421be600306bfb, region_id=RegionOne) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:30.154653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:30.156057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:30.161254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 521/1041] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 8 01:01:30 2022] GET /identity/v3/endpoints?service_id=396945eec91648279b421be600306bfb&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:30.166793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:30.198844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 521/1042] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:30.237020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:30.273005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080c0ea-bfa6-4470-960f-bacec794ac4b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:30.307921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ef248-04f2-439f-bc36-28bf8bac1cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:30.308530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ef248-04f2-439f-bc36-28bf8bac1cdb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:30.308813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ef248-04f2-439f-bc36-28bf8bac1cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:30.309088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ef248-04f2-439f-bc36-28bf8bac1cdb None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:30.309749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ef248-04f2-439f-bc36-28bf8bac1cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:30.311112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ef248-04f2-439f-bc36-28bf8bac1cdb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:30.317826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 522/1043] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:01:30 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:01:30.467726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000ed21-84f1-4774-9e1c-bc06772420c6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:30.578117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000ed21-84f1-4774-9e1c-bc06772420c6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:30.615339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993978-1b74-47e1-896f-bd0a8d8dd818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:30.615981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993978-1b74-47e1-896f-bd0a8d8dd818 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:30.616259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993978-1b74-47e1-896f-bd0a8d8dd818 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:30.616528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993978-1b74-47e1-896f-bd0a8d8dd818 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:30.617660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f993978-1b74-47e1-896f-bd0a8d8dd818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:30.619158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f993978-1b74-47e1-896f-bd0a8d8dd818 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:30.621444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 522/1044] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:30.626702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ef248-04f2-439f-bc36-28bf8bac1cdb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:30.731241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ef248-04f2-439f-bc36-28bf8bac1cdb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:30.759605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:30.766617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2656f5b-0f85-4855-9dea-361922cb5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:30.767167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2656f5b-0f85-4855-9dea-361922cb5310 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:30.767451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2656f5b-0f85-4855-9dea-361922cb5310 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:30.767732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2656f5b-0f85-4855-9dea-361922cb5310 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:30.768403 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2656f5b-0f85-4855-9dea-361922cb5310 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:30.769866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2656f5b-0f85-4855-9dea-361922cb5310 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:30.792268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 523/1045] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:01:30 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:01:31.901087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a616be-3d7b-40d9-9dfb-844910478ebf None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:31.901640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a616be-3d7b-40d9-9dfb-844910478ebf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:31.901718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a616be-3d7b-40d9-9dfb-844910478ebf None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:31.903729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 523/1046] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:31.908648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d883c-78c3-40f6-a642-fdd09a5c6770 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:31.909054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d883c-78c3-40f6-a642-fdd09a5c6770 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:31.909217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d883c-78c3-40f6-a642-fdd09a5c6770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:31.927776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-369d883c-78c3-40f6-a642-fdd09a5c6770 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:31.928970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-369d883c-78c3-40f6-a642-fdd09a5c6770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:31.995130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 524/1047] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:32.269859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a616be-3d7b-40d9-9dfb-844910478ebf None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:32.285346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:32.375101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a616be-3d7b-40d9-9dfb-844910478ebf None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:32.412214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa54c33-ae24-4de7-8fa2-587b26e32822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:32.412866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54c33-ae24-4de7-8fa2-587b26e32822 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:32.413141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54c33-ae24-4de7-8fa2-587b26e32822 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:32.413438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54c33-ae24-4de7-8fa2-587b26e32822 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:32.425170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa54c33-ae24-4de7-8fa2-587b26e32822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-baa54c33-ae24-4de7-8fa2-587b26e32822 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:32.430075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:32.431003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:32.434831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 524/1048] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 8 01:01:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:32.437681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d883c-78c3-40f6-a642-fdd09a5c6770 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:32.514727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc4f1-a3cd-4632-8c3c-4e663b47ec4f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:32.515015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc4f1-a3cd-4632-8c3c-4e663b47ec4f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:32.515294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc4f1-a3cd-4632-8c3c-4e663b47ec4f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:32.517436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 525/1049] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:32.522968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5e03-1cdd-4c1f-989b-053400640fca None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:32.523383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5e03-1cdd-4c1f-989b-053400640fca None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:32.523849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5e03-1cdd-4c1f-989b-053400640fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:32.553442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c4bb5e03-1cdd-4c1f-989b-053400640fca None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:32.554649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c4bb5e03-1cdd-4c1f-989b-053400640fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:32.555971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d883c-78c3-40f6-a642-fdd09a5c6770 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:32.575448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:32.596485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:32.597098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:32.597377 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:32.597692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:32.598359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:32.598788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:32.600155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:32.610226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 525/1050] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 8 01:01:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:32.617088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:32.633456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 526/1051] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:32.718187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b04fa-f0d6-4dfb-abf7-be9acf819329 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:32.752031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:32.752658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:32.752937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:32.753209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:32.765255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:32.766775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:32.781337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:32.782399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:32.783285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:32.783285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:32.783285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:32.783285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 526/1052] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:32.788238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5e03-1cdd-4c1f-989b-053400640fca None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:32.790838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:32.898308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5e03-1cdd-4c1f-989b-053400640fca None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:32.902331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:32.934215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:32.934774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:32.934969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:32.935241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:32.935886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:32.936185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:32.936480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:32.937948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:32.955802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 527/1053] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:32.957627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.015482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4152d-5178-45b3-8c36-bffaeec86f0d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.021222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:33.049211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5496b-c2e2-4899-aec8-c3d07f2b5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.049803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5496b-c2e2-4899-aec8-c3d07f2b5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.050088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5496b-c2e2-4899-aec8-c3d07f2b5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.050529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5496b-c2e2-4899-aec8-c3d07f2b5dc3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.051432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5496b-c2e2-4899-aec8-c3d07f2b5dc3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.052828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5496b-c2e2-4899-aec8-c3d07f2b5dc3 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.059294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc9e4-e6dd-487a-a1fb-912da1f75d6e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-8ce5496b-c2e2-4899-aec8-c3d07f2b5dc3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:33.061787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:33.062749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:33.063601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 527/1054] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Sep 8 01:01:32 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:33.064403 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa497a-2663-4e88-86fb-7ea9512a2b8a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.064403 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa497a-2663-4e88-86fb-7ea9512a2b8a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.064533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa497a-2663-4e88-86fb-7ea9512a2b8a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.065907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 528/1055] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:33.068527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa497a-2663-4e88-86fb-7ea9512a2b8a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.095908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a7c5-b14d-4fe7-8c95-bd87aaa442f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.096593 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a7c5-b14d-4fe7-8c95-bd87aaa442f2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.096876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a7c5-b14d-4fe7-8c95-bd87aaa442f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.097145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a7c5-b14d-4fe7-8c95-bd87aaa442f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.104401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955a7c5-b14d-4fe7-8c95-bd87aaa442f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.105867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955a7c5-b14d-4fe7-8c95-bd87aaa442f2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4955a7c5-b14d-4fe7-8c95-bd87aaa442f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:33.116755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:33.117871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 528/1056] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:01:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bce8e-2859-4f83-a6a3-c603dab3e9df None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.124599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bce8e-2859-4f83-a6a3-c603dab3e9df None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.125303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bce8e-2859-4f83-a6a3-c603dab3e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.140429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e78bce8e-2859-4f83-a6a3-c603dab3e9df None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:33.141631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e78bce8e-2859-4f83-a6a3-c603dab3e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:33.163950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:33.170908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa497a-2663-4e88-86fb-7ea9512a2b8a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.204837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.205466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.205750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.206023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.206644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] RBAC: Adding query filter params (name=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:33.206945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.207040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 529/1057] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:33.207816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bce8e-2859-4f83-a6a3-c603dab3e9df None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.208300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.218308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 529/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:33.219497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.269187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:33.316626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bce8e-2859-4f83-a6a3-c603dab3e9df None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.328964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb98d1-4905-4e75-96af-6569f460cedf None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.352159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.352999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.353517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.353970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.354895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:33.355389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.356891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.364732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.365246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.365563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.365838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.366457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] RBAC: Adding query filter params (type=image) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:33.366758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.368099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.373539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 530/1059] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:33.380143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 530/1060] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:33.380291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.381027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.408374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:33.483589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d5fbc-7afb-4cb7-b861-6c7fd42f2a31 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.487933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9eb2a-cd4b-405c-acf4-7f3991273d08 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.494142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:33.522644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.523277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.523555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.523833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.525810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb995-baa3-4047-b5c3-174185ced694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.526424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb995-baa3-4047-b5c3-174185ced694 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.526703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb995-baa3-4047-b5c3-174185ced694 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.526977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb995-baa3-4047-b5c3-174185ced694 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.527648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeb995-baa3-4047-b5c3-174185ced694 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.529043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeb995-baa3-4047-b5c3-174185ced694 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.533854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.535285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.549420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 531/1061] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:01:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:01:33.550238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb995-baa3-4047-b5c3-174185ced694 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:33.551303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:33.552213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:33.553149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:33.553149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:33.553149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:33.553149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 531/1062] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:33.567205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.647200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:33.678133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb995-baa3-4047-b5c3-174185ced694 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.680798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af4538-06d7-44a2-9a54-c20ad6c4b385 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.717010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d9d0-0c7f-406a-9f3d-0dc4ca2b4326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.717546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.717956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d9d0-0c7f-406a-9f3d-0dc4ca2b4326 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.718227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.718417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d9d0-0c7f-406a-9f3d-0dc4ca2b4326 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.718517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.718770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.718925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d9d0-0c7f-406a-9f3d-0dc4ca2b4326 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.719481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:33.719760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.721120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.733261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0d9d0-0c7f-406a-9f3d-0dc4ca2b4326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:33.734348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 532/1063] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-9fe0d9d0-0c7f-406a-9f3d-0dc4ca2b4326 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:33.737456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:33.738507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:33.739392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 532/1064] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:33.740096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.745312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d9d0-0c7f-406a-9f3d-0dc4ca2b4326 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.767857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:33.847631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0c5d0-7e70-4771-8c34-6c56c956098c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.856847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d9d0-0c7f-406a-9f3d-0dc4ca2b4326 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:33.883406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.884039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.884311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.884577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.892072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.893546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.904455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:33.905539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:33.905643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:33.906629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:33.907591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 533/1065] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:33.908506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:33.908793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:33.909532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:33.909842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:33.911219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:33.913721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:33.915157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:33.923079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 533/1066] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:33.928711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:34.000806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:34.021760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ebda0-e9c5-4ae2-9f02-8cccfcaaa7cd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:34.040602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cf450-b864-481f-932a-1dfef7e9fe8d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:34.057376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:34.058014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:34.058296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:34.058571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:34.060237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:34.060237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:34.061065 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:34.073512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 534/1067] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:34.077906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685dd86-acfc-4cca-9341-79f4a1c1eb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:34.078801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685dd86-acfc-4cca-9341-79f4a1c1eb75 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:34.079085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685dd86-acfc-4cca-9341-79f4a1c1eb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:34.079182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:34.079353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685dd86-acfc-4cca-9341-79f4a1c1eb75 None admin] PATH_INFO: `/v3/users/48b4c22a763a49db903bd24a51c99915` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:34.096452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685dd86-acfc-4cca-9341-79f4a1c1eb75 None admin] RBAC: Authorizing `identity:get_user(user_id=48b4c22a763a49db903bd24a51c99915)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:34.098003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685dd86-acfc-4cca-9341-79f4a1c1eb75 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:34.104162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 534/1068] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:33 2022] GET /identity/v3/users/48b4c22a763a49db903bd24a51c99915 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:34.105512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685dd86-acfc-4cca-9341-79f4a1c1eb75 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:34.167935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:34.183933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc3e53-3de9-4932-8ca7-ac5155c546f2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:34.216035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685dd86-acfc-4cca-9341-79f4a1c1eb75 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:34.226595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51a5dd-d8b2-4582-ae8d-f83ec4e1e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:34.227262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51a5dd-d8b2-4582-ae8d-f83ec4e1e1dd None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:34.227542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51a5dd-d8b2-4582-ae8d-f83ec4e1e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:34.227818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51a5dd-d8b2-4582-ae8d-f83ec4e1e1dd None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/1b9f7c644bde4c94a8cfe5ec13e782c3/roles/27f2eddc8e8843c79e44d0a15aec14ca` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:34.230060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51a5dd-d8b2-4582-ae8d-f83ec4e1e1dd None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=1b9f7c644bde4c94a8cfe5ec13e782c3, role_id=27f2eddc8e8843c79e44d0a15aec14ca)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:34.232245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51a5dd-d8b2-4582-ae8d-f83ec4e1e1dd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:34.246133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 535/1069] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:01:34 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/1b9f7c644bde4c94a8cfe5ec13e782c3/roles/27f2eddc8e8843c79e44d0a15aec14ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:01:34.269618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b103840-6f87-46b3-b6a0-f53ce9132ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:34.270598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b103840-6f87-46b3-b6a0-f53ce9132ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:34.271027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b103840-6f87-46b3-b6a0-f53ce9132ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:34.271407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b103840-6f87-46b3-b6a0-f53ce9132ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:34.348229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b103840-6f87-46b3-b6a0-f53ce9132ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:34.349681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b103840-6f87-46b3-b6a0-f53ce9132ed4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:34.409942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:34.458411 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 535/1070] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 01:01:34.464193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51a5dd-d8b2-4582-ae8d-f83ec4e1e1dd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:34.467749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:34.581670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51a5dd-d8b2-4582-ae8d-f83ec4e1e1dd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:34.616611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa692d6f-d590-4307-845f-eed4eec4da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:34.617160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa692d6f-d590-4307-845f-eed4eec4da9e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:34.617468 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa692d6f-d590-4307-845f-eed4eec4da9e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:34.617742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa692d6f-d590-4307-845f-eed4eec4da9e None admin] PATH_INFO: `/v3/projects/9826ff46b2d640218986e1331fa57bef` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:34.618842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa692d6f-d590-4307-845f-eed4eec4da9e None admin] RBAC: Authorizing `identity:get_project(project_id=9826ff46b2d640218986e1331fa57bef)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:34.620258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa692d6f-d590-4307-845f-eed4eec4da9e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:34.622437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 536/1071] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:01:34 2022] GET /identity/v3/projects/9826ff46b2d640218986e1331fa57bef => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:34.628590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b103840-6f87-46b3-b6a0-f53ce9132ed4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:34.729797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b103840-6f87-46b3-b6a0-f53ce9132ed4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:34.766196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b719678-bd1e-44d4-8b30-a6273f3b19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:34.766890 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719678-bd1e-44d4-8b30-a6273f3b19ae None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:34.767239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719678-bd1e-44d4-8b30-a6273f3b19ae None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:34.767576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719678-bd1e-44d4-8b30-a6273f3b19ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:34.768367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b719678-bd1e-44d4-8b30-a6273f3b19ae None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=9826ff46b2d640218986e1331fa57bef, user.id=48b4c22a763a49db903bd24a51c99915) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:34.768745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b719678-bd1e-44d4-8b30-a6273f3b19ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:34.770263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b719678-bd1e-44d4-8b30-a6273f3b19ae None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:34.781653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 536/1072] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:34 2022] GET /identity/v3/role_assignments?user.id=48b4c22a763a49db903bd24a51c99915&scope.project.id=9826ff46b2d640218986e1331fa57bef&role.id=c182619b007b495f912901d866e751e1 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:35.734632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b08a-f7b4-447f-8690-0b95d42e248c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:35.735175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b08a-f7b4-447f-8690-0b95d42e248c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:35.735175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b08a-f7b4-447f-8690-0b95d42e248c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:35.736629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 537/1073] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:35.741670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56027-bd6b-4748-b9af-de2186e7a3b5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:35.742079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56027-bd6b-4748-b9af-de2186e7a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:35.742240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56027-bd6b-4748-b9af-de2186e7a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:35.760418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-08c56027-bd6b-4748-b9af-de2186e7a3b5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:35.761572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-08c56027-bd6b-4748-b9af-de2186e7a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:35.776796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:35.833442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 537/1074] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:36.098969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77b08a-f7b4-447f-8690-0b95d42e248c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:36.169663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:36.203317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77b08a-f7b4-447f-8690-0b95d42e248c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:36.235563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d254376-7e96-498e-8a6d-25beb8ef04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:36.236162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254376-7e96-498e-8a6d-25beb8ef04a2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:36.236437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254376-7e96-498e-8a6d-25beb8ef04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:36.236704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254376-7e96-498e-8a6d-25beb8ef04a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:36.303241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d254376-7e96-498e-8a6d-25beb8ef04a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:36.304681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d254376-7e96-498e-8a6d-25beb8ef04a2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:36.376258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:36.413449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 538/1075] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:01:36.415493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56027-bd6b-4748-b9af-de2186e7a3b5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:36.456484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8ccb-08e0-4125-938d-a85ec799fba0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:36.456792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8ccb-08e0-4125-938d-a85ec799fba0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:36.457043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8ccb-08e0-4125-938d-a85ec799fba0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:36.458568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 539/1076] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:36.463385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119089-41dc-421f-b24b-2bca373f25df None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:36.463672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119089-41dc-421f-b24b-2bca373f25df None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:36.463950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119089-41dc-421f-b24b-2bca373f25df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:36.482140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dd119089-41dc-421f-b24b-2bca373f25df None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:36.483326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dd119089-41dc-421f-b24b-2bca373f25df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:36.527924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56027-bd6b-4748-b9af-de2186e7a3b5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:36.560779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 540/1077] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:36.568812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:36.569500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:36.569789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:36.570067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:36.581018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:36.582491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:36.597881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:36.598823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:36.599701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:36.599701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:36.599701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:36.600424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 538/1078] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:36.604962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119089-41dc-421f-b24b-2bca373f25df None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:36.705204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:36.708873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119089-41dc-421f-b24b-2bca373f25df None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:36.744446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89382b95-a911-462a-b4fd-9bd3d8f55134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:36.745108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89382b95-a911-462a-b4fd-9bd3d8f55134 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:36.745337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89382b95-a911-462a-b4fd-9bd3d8f55134 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:36.745640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89382b95-a911-462a-b4fd-9bd3d8f55134 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:36.746287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89382b95-a911-462a-b4fd-9bd3d8f55134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:36.747140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89382b95-a911-462a-b4fd-9bd3d8f55134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:36.748522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89382b95-a911-462a-b4fd-9bd3d8f55134 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:36.765454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 541/1079] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:36.834263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:36.837661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:36.895224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4729f-cd0a-43b2-b60f-c4a7de1816ca None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:36.895609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4729f-cd0a-43b2-b60f-c4a7de1816ca None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:36.895790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4729f-cd0a-43b2-b60f-c4a7de1816ca None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:36.897296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 542/1080] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:36.904044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732df95-493d-429c-b682-42a1da2c05b2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:36.904329 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732df95-493d-429c-b682-42a1da2c05b2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:36.904604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732df95-493d-429c-b682-42a1da2c05b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:36.923817 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5732df95-493d-429c-b682-42a1da2c05b2 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:36.925033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5732df95-493d-429c-b682-42a1da2c05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:36.951482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3004b-6901-4cae-a788-abce7964853b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:36.993091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e0f06-fa35-4eb8-89e2-e150d92546c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:36.993636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e0f06-fa35-4eb8-89e2-e150d92546c8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:36.993922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e0f06-fa35-4eb8-89e2-e150d92546c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:36.994280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e0f06-fa35-4eb8-89e2-e150d92546c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.007353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e0f06-fa35-4eb8-89e2-e150d92546c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:37.010817 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 543/1081] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-b29e0f06-fa35-4eb8-89e2-e150d92546c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:37.012289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:37.013573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:37.014935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 539/1082] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Sep 8 01:01:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:37.019426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732df95-493d-429c-b682-42a1da2c05b2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.112244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:37.122906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732df95-493d-429c-b682-42a1da2c05b2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.156264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.156859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.157135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.157443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.158079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:37.158376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:37.159719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:37.167494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 544/1083] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:37.172999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e0f06-fa35-4eb8-89e2-e150d92546c8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.232465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:37.272006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e0f06-fa35-4eb8-89e2-e150d92546c8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.282221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.305337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.306059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.306338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.306609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.319110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:37.320541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:37.335275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:37.336233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:37.337151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:37.337151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:37.337151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:37.337151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 540/1084] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:37.342067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.381517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88050c-3c26-4eef-a142-38ab9df8ff36 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.415579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624619e-d0af-4234-a220-f495721e5a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.416202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624619e-d0af-4234-a220-f495721e5a05 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.416831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624619e-d0af-4234-a220-f495721e5a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.417118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624619e-d0af-4234-a220-f495721e5a05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.428411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624619e-d0af-4234-a220-f495721e5a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e624619e-d0af-4234-a220-f495721e5a05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:37.433251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:37.434436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:01:37.435282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:37.438927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afa2fe-9986-4ae1-a3a3-96894d3b12df None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.439563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 545/1085] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:37.440399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624619e-d0af-4234-a220-f495721e5a05 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.453210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:37.455225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:37.473819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.474415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.474694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.474963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.475622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:37.475923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:37.477278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:37.488951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 541/1086] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:37.494612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.545613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624619e-d0af-4234-a220-f495721e5a05 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.578091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.578699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.578979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.579253 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.579910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:37.580212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:37.581614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:37.590036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 546/1087] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:37.595853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.599970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e60fe6-871e-48bf-849a-eed95e71e89b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.633450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.634068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.634344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.634613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.641690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:37.643112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:01:37.654819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:37.655938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:37.657090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 542/1088] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:01:37.661664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.671828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:37.695145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:37.697857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8dae4-02c1-4de6-8ed2-7ef87f5f8360 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.731590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1a750-ec10-4c8c-a57e-f9f69abaf92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.732215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1a750-ec10-4c8c-a57e-f9f69abaf92f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.732485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1a750-ec10-4c8c-a57e-f9f69abaf92f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.732751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1a750-ec10-4c8c-a57e-f9f69abaf92f None admin] PATH_INFO: `/v3/users/48b4c22a763a49db903bd24a51c99915` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.733896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1a750-ec10-4c8c-a57e-f9f69abaf92f None admin] RBAC: Authorizing `identity:get_user(user_id=48b4c22a763a49db903bd24a51c99915)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:37.735305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1a750-ec10-4c8c-a57e-f9f69abaf92f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:37.736865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 547/1089] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/users/48b4c22a763a49db903bd24a51c99915 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:37.742440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1a750-ec10-4c8c-a57e-f9f69abaf92f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.767214 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb44db-e6c0-4624-ab8c-66c850f2ea37 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.800591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.801134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.801446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.801729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.802450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:37.802760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:37.804189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:37.821657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 543/1090] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:37.827429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.839028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1a750-ec10-4c8c-a57e-f9f69abaf92f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.875064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a493b-e4fc-46fb-b85e-940cc9083cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.875567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a493b-e4fc-46fb-b85e-940cc9083cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.875890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a493b-e4fc-46fb-b85e-940cc9083cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.876226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a493b-e4fc-46fb-b85e-940cc9083cf2 None admin] PATH_INFO: `/v3/projects/9826ff46b2d640218986e1331fa57bef` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:37.877396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a493b-e4fc-46fb-b85e-940cc9083cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=9826ff46b2d640218986e1331fa57bef)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:37.878841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a493b-e4fc-46fb-b85e-940cc9083cf2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:37.880466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 548/1091] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/projects/9826ff46b2d640218986e1331fa57bef => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:01:37.886279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a493b-e4fc-46fb-b85e-940cc9083cf2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:37.898238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:37.922351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:37.931959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887e8f-cef3-4ba3-a8e7-ea7e89aa5e3f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:37.966631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ce17b-160b-418b-8b82-2af65a6fe7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:37.967236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce17b-160b-418b-8b82-2af65a6fe7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:37.967513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce17b-160b-418b-8b82-2af65a6fe7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:37.967785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ce17b-160b-418b-8b82-2af65a6fe7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:38.002589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a493b-e4fc-46fb-b85e-940cc9083cf2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:38.036177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ce17b-160b-418b-8b82-2af65a6fe7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:38.037433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c118cc3-5c95-4052-b263-966b1a668043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:38.037672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ce17b-160b-418b-8b82-2af65a6fe7a2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:38.038077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c118cc3-5c95-4052-b263-966b1a668043 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:38.038357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c118cc3-5c95-4052-b263-966b1a668043 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:38.038629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c118cc3-5c95-4052-b263-966b1a668043 None admin] PATH_INFO: `/v3/projects/9826ff46b2d640218986e1331fa57bef/users/48b4c22a763a49db903bd24a51c99915/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:38.040532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c118cc3-5c95-4052-b263-966b1a668043 None admin] RBAC: Authorizing `identity:create_grant(project_id=9826ff46b2d640218986e1331fa57bef, user_id=48b4c22a763a49db903bd24a51c99915, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:38.041977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c118cc3-5c95-4052-b263-966b1a668043 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:38.054387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 549/1092] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:01:37 2022] PUT /identity/v3/projects/9826ff46b2d640218986e1331fa57bef/users/48b4c22a763a49db903bd24a51c99915/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:01:38.134841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:38.145838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 544/1093] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 01:01:38.151818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c118cc3-5c95-4052-b263-966b1a668043 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:38.225704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:38.257027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c118cc3-5c95-4052-b263-966b1a668043 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:38.292688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:38.293338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:38.293657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:38.293934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:38.303899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:38.305458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:01:38.319934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:38.320960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:01:38.321886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:01:38.321886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:01:38.321886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:38.321886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 550/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:38.327227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ce17b-160b-418b-8b82-2af65a6fe7a2 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:38.424475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ce17b-160b-418b-8b82-2af65a6fe7a2 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:38.457424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:38.458051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:38.458332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:38.458602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:38.459240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:38.459543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:38.460897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:38.472481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 545/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:38.478178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:38.579061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea2be-9576-4eb5-b694-cfe70cc9e81d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:38.600845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:38.613532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:38.614151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:38.614428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:38.614698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:38.621145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:38.622633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:01:38.633702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:38.634640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:38.635569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:01:38.635569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:01:38.635569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:01:38.635569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:01:38.635569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:01:38.635569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:01:38.635569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:01:38.635569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:01:38.637547 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 551/1096] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:38.640821 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:38.692920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:38.740225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e010d-d555-48bc-aa28-984c62744c99 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:38.773647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc874b-f51c-4898-94c1-16fc6f5eb9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:38.774252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc874b-f51c-4898-94c1-16fc6f5eb9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:38.774532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc874b-f51c-4898-94c1-16fc6f5eb9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:38.774804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc874b-f51c-4898-94c1-16fc6f5eb9c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:38.775490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc874b-f51c-4898-94c1-16fc6f5eb9c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:38.775797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc874b-f51c-4898-94c1-16fc6f5eb9c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:38.777218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc874b-f51c-4898-94c1-16fc6f5eb9c7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:38.789703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 546/1097] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:38.795961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:38.893838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1d6d0-b8d0-4305-8711-dffd529c8f6b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:38.928384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ce5d9-d465-49a8-8b43-babe13baaa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:38.928982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce5d9-d465-49a8-8b43-babe13baaa3a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:38.929257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce5d9-d465-49a8-8b43-babe13baaa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:38.929560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce5d9-d465-49a8-8b43-babe13baaa3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:38.930271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ce5d9-d465-49a8-8b43-babe13baaa3a None admin] RBAC: Adding query filter params (role.id=27f2eddc8e8843c79e44d0a15aec14ca, scope.project.id=454105f786874ed1b407da41aef24389, user.id=1b9f7c644bde4c94a8cfe5ec13e782c3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:38.930576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ce5d9-d465-49a8-8b43-babe13baaa3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:38.931987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ce5d9-d465-49a8-8b43-babe13baaa3a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:38.937880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 552/1098] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:38 2022] GET /identity/v3/role_assignments?user.id=1b9f7c644bde4c94a8cfe5ec13e782c3&scope.project.id=454105f786874ed1b407da41aef24389&role.id=27f2eddc8e8843c79e44d0a15aec14ca => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:40.207135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314abe-e86e-4be8-ae6e-278bd0c9c75d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:40.207704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314abe-e86e-4be8-ae6e-278bd0c9c75d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:40.207704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42314abe-e86e-4be8-ae6e-278bd0c9c75d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:40.209028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 547/1099] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:40.214391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab535e4-6966-41ba-890d-aa4162d45e7f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:40.214790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab535e4-6966-41ba-890d-aa4162d45e7f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:40.214942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab535e4-6966-41ba-890d-aa4162d45e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:40.233716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3ab535e4-6966-41ba-890d-aa4162d45e7f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:40.234879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3ab535e4-6966-41ba-890d-aa4162d45e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:40.276010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:40.299986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 553/1100] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:40.562465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314abe-e86e-4be8-ae6e-278bd0c9c75d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:40.661053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42314abe-e86e-4be8-ae6e-278bd0c9c75d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:40.673577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:40.694734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a85f86-067b-4484-a42a-9d87b6f92dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:40.695344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85f86-067b-4484-a42a-9d87b6f92dca None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:40.695623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85f86-067b-4484-a42a-9d87b6f92dca None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:40.695898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85f86-067b-4484-a42a-9d87b6f92dca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:40.705797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a85f86-067b-4484-a42a-9d87b6f92dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c3a85f86-067b-4484-a42a-9d87b6f92dca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:01:40.710583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:01:40.711640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:01:40.712779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 548/1101] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:01:40.718033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab535e4-6966-41ba-890d-aa4162d45e7f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:40.813843 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab535e4-6966-41ba-890d-aa4162d45e7f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:40.846573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:40.847173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:40.847462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:40.847725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:40.848381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:40.848730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:40.850067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:40.858522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 554/1102] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:40.864578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a85f86-067b-4484-a42a-9d87b6f92dca None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:40.962295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a85f86-067b-4484-a42a-9d87b6f92dca None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:40.995894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8953c-8fdf-459a-a0eb-02bdc0dcc6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:40.996527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8953c-8fdf-459a-a0eb-02bdc0dcc6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:40.996804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8953c-8fdf-459a-a0eb-02bdc0dcc6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:40.997073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8953c-8fdf-459a-a0eb-02bdc0dcc6c8 None admin] PATH_INFO: `/v3/users/48b4c22a763a49db903bd24a51c99915` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:40.998369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8953c-8fdf-459a-a0eb-02bdc0dcc6c8 None admin] RBAC: Authorizing `identity:get_user(user_id=48b4c22a763a49db903bd24a51c99915)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:41.003449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8953c-8fdf-459a-a0eb-02bdc0dcc6c8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:41.005041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 549/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:40 2022] GET /identity/v3/users/48b4c22a763a49db903bd24a51c99915 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:41.010914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:41.050769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:41.113484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d966-802f-4b62-a580-a139ca95ddec None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:41.146382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d5623-da99-4414-8d54-ff05701a8a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:41.146984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5623-da99-4414-8d54-ff05701a8a7b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:41.147265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5623-da99-4414-8d54-ff05701a8a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:41.147536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5623-da99-4414-8d54-ff05701a8a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:41.217163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d5623-da99-4414-8d54-ff05701a8a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:41.219711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d5623-da99-4414-8d54-ff05701a8a7b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:41.269727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:41.337984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 555/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:01:41.344524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8953c-8fdf-459a-a0eb-02bdc0dcc6c8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:41.385003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:41.441444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8953c-8fdf-459a-a0eb-02bdc0dcc6c8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:41.474055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d1854-c71f-434a-98d2-4c48485b1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:41.474664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d1854-c71f-434a-98d2-4c48485b1d94 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:41.474945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d1854-c71f-434a-98d2-4c48485b1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:41.475218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d1854-c71f-434a-98d2-4c48485b1d94 None admin] PATH_INFO: `/v3/projects/9826ff46b2d640218986e1331fa57bef` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:41.476311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d1854-c71f-434a-98d2-4c48485b1d94 None admin] RBAC: Authorizing `identity:get_project(project_id=9826ff46b2d640218986e1331fa57bef)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:41.477757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d1854-c71f-434a-98d2-4c48485b1d94 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:41.479343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 550/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:01:41 2022] GET /identity/v3/projects/9826ff46b2d640218986e1331fa57bef => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:41.485338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d5623-da99-4414-8d54-ff05701a8a7b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:41.583721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d5623-da99-4414-8d54-ff05701a8a7b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:41.617488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac305a4-6911-4635-9699-e53a2732a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:41.618091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac305a4-6911-4635-9699-e53a2732a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:41.618443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac305a4-6911-4635-9699-e53a2732a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:41.618711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac305a4-6911-4635-9699-e53a2732a3a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:41.619422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac305a4-6911-4635-9699-e53a2732a3a7 None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=9826ff46b2d640218986e1331fa57bef, user.id=48b4c22a763a49db903bd24a51c99915) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:41.619729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac305a4-6911-4635-9699-e53a2732a3a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:41.621153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac305a4-6911-4635-9699-e53a2732a3a7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:41.627426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 556/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:41 2022] GET /identity/v3/role_assignments?user.id=48b4c22a763a49db903bd24a51c99915&scope.project.id=9826ff46b2d640218986e1331fa57bef&role.id=c182619b007b495f912901d866e751e1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:43.768335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32b96c-9413-4ad0-922b-fd78ce3a9c7a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:43.768839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32b96c-9413-4ad0-922b-fd78ce3a9c7a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:43.768839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32b96c-9413-4ad0-922b-fd78ce3a9c7a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:43.770154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 551/1107] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:43.775492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17076247-9b86-4f88-8e04-6118fce5dc67 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:43.775898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17076247-9b86-4f88-8e04-6118fce5dc67 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:43.776141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17076247-9b86-4f88-8e04-6118fce5dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:43.782866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:43.795982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-17076247-9b86-4f88-8e04-6118fce5dc67 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:43.797152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-17076247-9b86-4f88-8e04-6118fce5dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:43.862056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 557/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:44.128000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32b96c-9413-4ad0-922b-fd78ce3a9c7a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:44.229241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32b96c-9413-4ad0-922b-fd78ce3a9c7a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:44.238267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:44.263086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3f05f-695b-4fab-97c0-172ab653323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:44.263950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3f05f-695b-4fab-97c0-172ab653323b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:44.264230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3f05f-695b-4fab-97c0-172ab653323b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:44.264505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3f05f-695b-4fab-97c0-172ab653323b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:44.265639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3f05f-695b-4fab-97c0-172ab653323b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:44.267055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3f05f-695b-4fab-97c0-172ab653323b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:44.268592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 552/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:44.274341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17076247-9b86-4f88-8e04-6118fce5dc67 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:44.369032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17076247-9b86-4f88-8e04-6118fce5dc67 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:44.398055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:44.403505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc03496-9542-47ac-bc80-cbe52b9cea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:44.404103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03496-9542-47ac-bc80-cbe52b9cea38 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:44.404385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03496-9542-47ac-bc80-cbe52b9cea38 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:44.404653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc03496-9542-47ac-bc80-cbe52b9cea38 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:44.405305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc03496-9542-47ac-bc80-cbe52b9cea38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:44.406757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc03496-9542-47ac-bc80-cbe52b9cea38 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:44.426696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 558/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:01:44 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:01:46.570999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f1b25-15fd-4396-98c1-aa2b91e0bbdb None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:46.571486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f1b25-15fd-4396-98c1-aa2b91e0bbdb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:46.571602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f1b25-15fd-4396-98c1-aa2b91e0bbdb None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:46.572864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 553/1111] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:46.578649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021d3b-e36b-4099-acb6-dd23f73db373 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:46.579061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021d3b-e36b-4099-acb6-dd23f73db373 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:46.579191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1021d3b-e36b-4099-acb6-dd23f73db373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:46.597503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b1021d3b-e36b-4099-acb6-dd23f73db373 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:46.598671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b1021d3b-e36b-4099-acb6-dd23f73db373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:46.662597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 559/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:01:46.932029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f1b25-15fd-4396-98c1-aa2b91e0bbdb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:47.031310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f1b25-15fd-4396-98c1-aa2b91e0bbdb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:47.064526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22810af9-48f5-4169-b780-4ca604ec88d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:47.065520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22810af9-48f5-4169-b780-4ca604ec88d8 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:47.065866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22810af9-48f5-4169-b780-4ca604ec88d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:47.066139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22810af9-48f5-4169-b780-4ca604ec88d8 None admin] PATH_INFO: `/v3/roles/72b0245082944533beab3a422c3c640a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:47.067523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22810af9-48f5-4169-b780-4ca604ec88d8 None admin] RBAC: Authorizing `identity:get_role(role_id=72b0245082944533beab3a422c3c640a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:47.068869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22810af9-48f5-4169-b780-4ca604ec88d8 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:47.070209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 554/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:46 2022] GET /identity/v3/roles/72b0245082944533beab3a422c3c640a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:47.076033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1021d3b-e36b-4099-acb6-dd23f73db373 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:47.171656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1021d3b-e36b-4099-acb6-dd23f73db373 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:47.189209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:47.206402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260de6d-7de2-476d-a555-10566b4dc724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:47.207024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260de6d-7de2-476d-a555-10566b4dc724 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:47.207304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260de6d-7de2-476d-a555-10566b4dc724 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:47.207579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260de6d-7de2-476d-a555-10566b4dc724 None admin] PATH_INFO: `/v3/users/b3df6bac6b874707b534a6fdf4150170` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:47.220503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260de6d-7de2-476d-a555-10566b4dc724 None admin] RBAC: Authorizing `identity:get_user(user_id=b3df6bac6b874707b534a6fdf4150170)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:47.221969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260de6d-7de2-476d-a555-10566b4dc724 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:47.223555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 560/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:47 2022] GET /identity/v3/users/b3df6bac6b874707b534a6fdf4150170 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:47.229457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22810af9-48f5-4169-b780-4ca604ec88d8 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:47.274106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:47.327159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22810af9-48f5-4169-b780-4ca604ec88d8 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:47.363650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dd78b-f847-4268-be2d-4961c7ea941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:47.364246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd78b-f847-4268-be2d-4961c7ea941a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:47.364522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd78b-f847-4268-be2d-4961c7ea941a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:47.364793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd78b-f847-4268-be2d-4961c7ea941a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:47.430150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dd78b-f847-4268-be2d-4961c7ea941a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:47.431595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dd78b-f847-4268-be2d-4961c7ea941a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:47.472857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:47.526067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 555/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:01:47.532466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260de6d-7de2-476d-a555-10566b4dc724 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:47.628555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260de6d-7de2-476d-a555-10566b4dc724 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:47.661173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd580b-3b61-4597-9e88-d6e83efe4724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:47.661828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd580b-3b61-4597-9e88-d6e83efe4724 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:47.662108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd580b-3b61-4597-9e88-d6e83efe4724 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:47.662379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd580b-3b61-4597-9e88-d6e83efe4724 None admin] PATH_INFO: `/v3/projects/9826ff46b2d640218986e1331fa57bef` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:47.663484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd580b-3b61-4597-9e88-d6e83efe4724 None admin] RBAC: Authorizing `identity:get_project(project_id=9826ff46b2d640218986e1331fa57bef)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:47.664904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd580b-3b61-4597-9e88-d6e83efe4724 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:47.666554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 561/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:01:47 2022] GET /identity/v3/projects/9826ff46b2d640218986e1331fa57bef => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:47.673234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dd78b-f847-4268-be2d-4961c7ea941a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:47.772222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dd78b-f847-4268-be2d-4961c7ea941a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:47.804468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814547-7127-4742-a6ac-58848b2050dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:47.805061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814547-7127-4742-a6ac-58848b2050dd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:47.805337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814547-7127-4742-a6ac-58848b2050dd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:47.805634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814547-7127-4742-a6ac-58848b2050dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:47.806341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814547-7127-4742-a6ac-58848b2050dd None admin] RBAC: Adding query filter params (role.id=72b0245082944533beab3a422c3c640a, scope.project.id=9826ff46b2d640218986e1331fa57bef, user.id=b3df6bac6b874707b534a6fdf4150170) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:47.806649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814547-7127-4742-a6ac-58848b2050dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:47.808065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814547-7127-4742-a6ac-58848b2050dd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:47.813219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 556/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:47 2022] GET /identity/v3/role_assignments?user.id=b3df6bac6b874707b534a6fdf4150170&scope.project.id=9826ff46b2d640218986e1331fa57bef&role.id=72b0245082944533beab3a422c3c640a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:49.904643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965669-5168-4238-a85d-4bbd312fc174 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:49.905141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965669-5168-4238-a85d-4bbd312fc174 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:49.905257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965669-5168-4238-a85d-4bbd312fc174 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:49.906557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 562/1118] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:49.911864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ccaf-9a2a-41f2-8efd-d5c234d26ecc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:49.912267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ccaf-9a2a-41f2-8efd-d5c234d26ecc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:49.912409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ccaf-9a2a-41f2-8efd-d5c234d26ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:49.930639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2645ccaf-9a2a-41f2-8efd-d5c234d26ecc None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:49.931824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2645ccaf-9a2a-41f2-8efd-d5c234d26ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:49.933793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:50.004445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 557/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:50.274988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6965669-5168-4238-a85d-4bbd312fc174 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:50.320768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:50.375174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6965669-5168-4238-a85d-4bbd312fc174 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:50.408218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eed11-e3e5-4ab0-b6f4-e5fa4f8b43cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:50.408822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eed11-e3e5-4ab0-b6f4-e5fa4f8b43cd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:50.409103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eed11-e3e5-4ab0-b6f4-e5fa4f8b43cd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:50.409374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eed11-e3e5-4ab0-b6f4-e5fa4f8b43cd None admin] PATH_INFO: `/v3/roles/72b0245082944533beab3a422c3c640a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:50.410765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eed11-e3e5-4ab0-b6f4-e5fa4f8b43cd None admin] RBAC: Authorizing `identity:get_role(role_id=72b0245082944533beab3a422c3c640a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:50.412128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eed11-e3e5-4ab0-b6f4-e5fa4f8b43cd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:50.413450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 563/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:50 2022] GET /identity/v3/roles/72b0245082944533beab3a422c3c640a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:50.419291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645ccaf-9a2a-41f2-8efd-d5c234d26ecc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:50.514234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645ccaf-9a2a-41f2-8efd-d5c234d26ecc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:50.546732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ea085-d593-48e6-a398-9a8036618b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:50.547297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea085-d593-48e6-a398-9a8036618b39 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:50.547573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea085-d593-48e6-a398-9a8036618b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:50.547843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea085-d593-48e6-a398-9a8036618b39 None admin] PATH_INFO: `/v3/users/b3df6bac6b874707b534a6fdf4150170` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:50.548940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ea085-d593-48e6-a398-9a8036618b39 None admin] RBAC: Authorizing `identity:get_user(user_id=b3df6bac6b874707b534a6fdf4150170)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:50.550383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ea085-d593-48e6-a398-9a8036618b39 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:50.551939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 558/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:50 2022] GET /identity/v3/users/b3df6bac6b874707b534a6fdf4150170 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:50.557659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eed11-e3e5-4ab0-b6f4-e5fa4f8b43cd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:50.653267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eed11-e3e5-4ab0-b6f4-e5fa4f8b43cd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:50.666315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:50.686971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339d5e9-2875-487f-a99c-2eb03b37f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:50.687585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339d5e9-2875-487f-a99c-2eb03b37f779 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:50.687861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339d5e9-2875-487f-a99c-2eb03b37f779 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:50.688127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339d5e9-2875-487f-a99c-2eb03b37f779 None admin] PATH_INFO: `/v3/projects/9826ff46b2d640218986e1331fa57bef` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:50.689212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339d5e9-2875-487f-a99c-2eb03b37f779 None admin] RBAC: Authorizing `identity:get_project(project_id=9826ff46b2d640218986e1331fa57bef)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:50.690652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339d5e9-2875-487f-a99c-2eb03b37f779 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:50.692243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 564/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:01:50 2022] GET /identity/v3/projects/9826ff46b2d640218986e1331fa57bef => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:50.698029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ea085-d593-48e6-a398-9a8036618b39 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:50.707253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:50.794712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ea085-d593-48e6-a398-9a8036618b39 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:50.826813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e458e85-fe0d-4456-8bad-7b41dcb2641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:50.827423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458e85-fe0d-4456-8bad-7b41dcb2641d None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:50.827701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458e85-fe0d-4456-8bad-7b41dcb2641d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:50.827971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458e85-fe0d-4456-8bad-7b41dcb2641d None admin] PATH_INFO: `/v3/projects/9826ff46b2d640218986e1331fa57bef/users/b3df6bac6b874707b534a6fdf4150170/roles/72b0245082944533beab3a422c3c640a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:50.830110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e458e85-fe0d-4456-8bad-7b41dcb2641d None admin] RBAC: Authorizing `identity:create_grant(project_id=9826ff46b2d640218986e1331fa57bef, user_id=b3df6bac6b874707b534a6fdf4150170, role_id=72b0245082944533beab3a422c3c640a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:50.831514 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e458e85-fe0d-4456-8bad-7b41dcb2641d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:50.844166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 559/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:01:50 2022] PUT /identity/v3/projects/9826ff46b2d640218986e1331fa57bef/users/b3df6bac6b874707b534a6fdf4150170/roles/72b0245082944533beab3a422c3c640a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:01:52.933465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4a3c1-dc29-4daa-86d8-eaa97b757542 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:52.933971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4a3c1-dc29-4daa-86d8-eaa97b757542 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:52.934080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4a3c1-dc29-4daa-86d8-eaa97b757542 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:52.935323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 565/1124] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:01:52.940461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844bb9e-b863-4d32-b642-f258e325ce3c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:52.940863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844bb9e-b863-4d32-b642-f258e325ce3c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:52.941025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844bb9e-b863-4d32-b642-f258e325ce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:52.958846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4844bb9e-b863-4d32-b642-f258e325ce3c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:52.960025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4844bb9e-b863-4d32-b642-f258e325ce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:53.018394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:53.026245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 560/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:53.294383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4a3c1-dc29-4daa-86d8-eaa97b757542 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:53.395393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4a3c1-dc29-4daa-86d8-eaa97b757542 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:53.428609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2948e2-f982-4da1-8ff9-082d12962987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:53.429221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2948e2-f982-4da1-8ff9-082d12962987 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:53.429519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2948e2-f982-4da1-8ff9-082d12962987 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:53.429788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2948e2-f982-4da1-8ff9-082d12962987 None admin] PATH_INFO: `/v3/roles/72b0245082944533beab3a422c3c640a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:53.431152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2948e2-f982-4da1-8ff9-082d12962987 None admin] RBAC: Authorizing `identity:get_role(role_id=72b0245082944533beab3a422c3c640a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:53.432508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2948e2-f982-4da1-8ff9-082d12962987 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:53.433875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 566/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:53 2022] GET /identity/v3/roles/72b0245082944533beab3a422c3c640a => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:53.439700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844bb9e-b863-4d32-b642-f258e325ce3c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:53.535171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844bb9e-b863-4d32-b642-f258e325ce3c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:53.568217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019441b-37b0-462a-a3c7-bfd866552c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:53.568779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019441b-37b0-462a-a3c7-bfd866552c57 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:53.569061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019441b-37b0-462a-a3c7-bfd866552c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:53.569334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019441b-37b0-462a-a3c7-bfd866552c57 None admin] PATH_INFO: `/v3/users/b3df6bac6b874707b534a6fdf4150170` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:53.570478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019441b-37b0-462a-a3c7-bfd866552c57 None admin] RBAC: Authorizing `identity:get_user(user_id=b3df6bac6b874707b534a6fdf4150170)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:53.571902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019441b-37b0-462a-a3c7-bfd866552c57 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:53.573644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 561/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:01:53 2022] GET /identity/v3/users/b3df6bac6b874707b534a6fdf4150170 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:53.579909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2948e2-f982-4da1-8ff9-082d12962987 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:53.626819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:53.676203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2948e2-f982-4da1-8ff9-082d12962987 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:53.711238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991033-c48f-4b2d-8081-aaff51992ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:53.711830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991033-c48f-4b2d-8081-aaff51992ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:53.712104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991033-c48f-4b2d-8081-aaff51992ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:53.712369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a991033-c48f-4b2d-8081-aaff51992ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:53.777487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a991033-c48f-4b2d-8081-aaff51992ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:53.778917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a991033-c48f-4b2d-8081-aaff51992ec7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:53.824432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:53.873824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 567/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:01:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:01:53.879774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019441b-37b0-462a-a3c7-bfd866552c57 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:53.941000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:53.977521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019441b-37b0-462a-a3c7-bfd866552c57 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:54.010344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f936b2-7a91-4670-abab-51eaab4331d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:54.010962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f936b2-7a91-4670-abab-51eaab4331d2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:54.011237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f936b2-7a91-4670-abab-51eaab4331d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:54.011508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f936b2-7a91-4670-abab-51eaab4331d2 None admin] PATH_INFO: `/v3/projects/9826ff46b2d640218986e1331fa57bef` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:54.012642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f936b2-7a91-4670-abab-51eaab4331d2 None admin] RBAC: Authorizing `identity:get_project(project_id=9826ff46b2d640218986e1331fa57bef)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:54.014350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f936b2-7a91-4670-abab-51eaab4331d2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:54.015972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 562/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:01:53 2022] GET /identity/v3/projects/9826ff46b2d640218986e1331fa57bef => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:54.022137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991033-c48f-4b2d-8081-aaff51992ec7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:54.116600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a991033-c48f-4b2d-8081-aaff51992ec7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:54.149234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b418f27-3efd-4091-8a96-1e729d501f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:54.149849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418f27-3efd-4091-8a96-1e729d501f32 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:54.150126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418f27-3efd-4091-8a96-1e729d501f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:54.150395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418f27-3efd-4091-8a96-1e729d501f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:54.151099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418f27-3efd-4091-8a96-1e729d501f32 None admin] RBAC: Adding query filter params (role.id=72b0245082944533beab3a422c3c640a, scope.project.id=9826ff46b2d640218986e1331fa57bef, user.id=b3df6bac6b874707b534a6fdf4150170) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:01:54.151402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418f27-3efd-4091-8a96-1e729d501f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:54.153334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418f27-3efd-4091-8a96-1e729d501f32 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:54.158886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 568/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:01:54 2022] GET /identity/v3/role_assignments?user.id=b3df6bac6b874707b534a6fdf4150170&scope.project.id=9826ff46b2d640218986e1331fa57bef&role.id=72b0245082944533beab3a422c3c640a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:56.286227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a2379-61a2-48a3-9572-69ea361a0cc2 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:56.286753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a2379-61a2-48a3-9572-69ea361a0cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:56.286753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a2379-61a2-48a3-9572-69ea361a0cc2 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:56.288086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 563/1131] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:56.293744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dccfe-5717-440d-b7f7-0eb3b32a8a24 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:56.294131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dccfe-5717-440d-b7f7-0eb3b32a8a24 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:56.294291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dccfe-5717-440d-b7f7-0eb3b32a8a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:56.312526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9b4dccfe-5717-440d-b7f7-0eb3b32a8a24 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:56.313742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9b4dccfe-5717-440d-b7f7-0eb3b32a8a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:56.320815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:56.382888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 569/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:56.648116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a2379-61a2-48a3-9572-69ea361a0cc2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:56.746843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a2379-61a2-48a3-9572-69ea361a0cc2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:56.775005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:56.780996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ed512-6b88-4234-9433-3c6445be3332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:56.781638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ed512-6b88-4234-9433-3c6445be3332 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:56.781915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ed512-6b88-4234-9433-3c6445be3332 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:56.782184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ed512-6b88-4234-9433-3c6445be3332 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:56.783275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ed512-6b88-4234-9433-3c6445be3332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:56.784689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ed512-6b88-4234-9433-3c6445be3332 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:56.786257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 564/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:56.792013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dccfe-5717-440d-b7f7-0eb3b32a8a24 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:56.888109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dccfe-5717-440d-b7f7-0eb3b32a8a24 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:56.920824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b114c-ad03-47b3-a0e9-192c02ce9e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:56.921358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b114c-ad03-47b3-a0e9-192c02ce9e63 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:56.921743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b114c-ad03-47b3-a0e9-192c02ce9e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:56.922015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b114c-ad03-47b3-a0e9-192c02ce9e63 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:56.922649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b114c-ad03-47b3-a0e9-192c02ce9e63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:56.924063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b114c-ad03-47b3-a0e9-192c02ce9e63 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:56.937684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:56.950413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 570/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:01:56 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:01:59.092197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5915-0f5b-4949-b7d0-61af64b8e05d None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:59.092724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5915-0f5b-4949-b7d0-61af64b8e05d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:59.092724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a5915-0f5b-4949-b7d0-61af64b8e05d None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:59.094110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 565/1135] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:01:59.099202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cfdf1-b925-4ad1-8d23-e58dcc37d14c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:59.099629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cfdf1-b925-4ad1-8d23-e58dcc37d14c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:59.099750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cfdf1-b925-4ad1-8d23-e58dcc37d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:59.118064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fd3cfdf1-b925-4ad1-8d23-e58dcc37d14c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:01:59.119237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fd3cfdf1-b925-4ad1-8d23-e58dcc37d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:01:59.183354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 571/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:01:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:01:59.448774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a5915-0f5b-4949-b7d0-61af64b8e05d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:59.551685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a5915-0f5b-4949-b7d0-61af64b8e05d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:59.583392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd5bfc-4dc4-4779-a1f2-8d54186acbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:59.583998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5bfc-4dc4-4779-a1f2-8d54186acbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:59.584276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5bfc-4dc4-4779-a1f2-8d54186acbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:59.584547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5bfc-4dc4-4779-a1f2-8d54186acbc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:59.585658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd5bfc-4dc4-4779-a1f2-8d54186acbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:59.587066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd5bfc-4dc4-4779-a1f2-8d54186acbc5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:59.588597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 566/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:01:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:01:59.594797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cfdf1-b925-4ad1-8d23-e58dcc37d14c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:01:59.690617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cfdf1-b925-4ad1-8d23-e58dcc37d14c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:01:59.712749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:01:59.724485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8122dfe-1e8b-4d20-b401-3282e37360ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:01:59.725081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8122dfe-1e8b-4d20-b401-3282e37360ee None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:01:59.725360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8122dfe-1e8b-4d20-b401-3282e37360ee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:01:59.725673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8122dfe-1e8b-4d20-b401-3282e37360ee None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:01:59.726313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8122dfe-1e8b-4d20-b401-3282e37360ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:01:59.727729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8122dfe-1e8b-4d20-b401-3282e37360ee None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:01:59.748621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 572/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:01:59 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:02:01.896035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a15ab-e35b-4df3-ac80-6718575c65a4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:01.896541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a15ab-e35b-4df3-ac80-6718575c65a4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:01.896727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a15ab-e35b-4df3-ac80-6718575c65a4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:01.897934 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 567/1139] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:01.903090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36680ae3-7b10-4440-9676-24b3b2f44c6f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:01.903498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36680ae3-7b10-4440-9676-24b3b2f44c6f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:01.903646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36680ae3-7b10-4440-9676-24b3b2f44c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:01.921328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-36680ae3-7b10-4440-9676-24b3b2f44c6f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:01.922523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-36680ae3-7b10-4440-9676-24b3b2f44c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:01.985858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 573/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:02.256789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a15ab-e35b-4df3-ac80-6718575c65a4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:02.321942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:02.359338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a15ab-e35b-4df3-ac80-6718575c65a4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:02.393335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153682-1f6c-41df-9c57-d5ec5fce7e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:02.393992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153682-1f6c-41df-9c57-d5ec5fce7e5b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:02.394300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153682-1f6c-41df-9c57-d5ec5fce7e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:02.394670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153682-1f6c-41df-9c57-d5ec5fce7e5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:02.404513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88153682-1f6c-41df-9c57-d5ec5fce7e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-88153682-1f6c-41df-9c57-d5ec5fce7e5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:02:02.409313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:02:02.410343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:02:02.411198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 568/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:02:02.416414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36680ae3-7b10-4440-9676-24b3b2f44c6f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:02.511993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36680ae3-7b10-4440-9676-24b3b2f44c6f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:02.522724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:02.547643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:02.548241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:02.548517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:02.548784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:02.549462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:02.549763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:02.551112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:02.559419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 574/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:02:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:02.565278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153682-1f6c-41df-9c57-d5ec5fce7e5b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:02.662410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153682-1f6c-41df-9c57-d5ec5fce7e5b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:02.694032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:02.705381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01245d68-1a3f-4299-a52b-24e686736689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:02.706032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01245d68-1a3f-4299-a52b-24e686736689 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:02.706315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01245d68-1a3f-4299-a52b-24e686736689 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:02.706590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01245d68-1a3f-4299-a52b-24e686736689 None admin] PATH_INFO: `/v3/users/3e45841080f44026a2464b0f0c4ced50` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:02.720463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01245d68-1a3f-4299-a52b-24e686736689 None admin] RBAC: Authorizing `identity:get_user(user_id=3e45841080f44026a2464b0f0c4ced50)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:02.721946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01245d68-1a3f-4299-a52b-24e686736689 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:02.723542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 569/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:02:02 2022] GET /identity/v3/users/3e45841080f44026a2464b0f0c4ced50 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:02.729511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:02.826867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9467-e2d9-4c27-ac1b-610e1e3a7353 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:02.858777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6b18-0b46-4365-990b-8ad920082228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:02.859365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6b18-0b46-4365-990b-8ad920082228 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:02.859643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6b18-0b46-4365-990b-8ad920082228 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:02.859911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6b18-0b46-4365-990b-8ad920082228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:02.899733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:02.928462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb6b18-0b46-4365-990b-8ad920082228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:02.929975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb6b18-0b46-4365-990b-8ad920082228 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:03.024111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 575/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:02:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:02:03.030112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01245d68-1a3f-4299-a52b-24e686736689 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:03.132643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01245d68-1a3f-4299-a52b-24e686736689 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:03.166367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893c137-7632-4f98-80af-ad3e1a798103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:03.166987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c137-7632-4f98-80af-ad3e1a798103 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:03.167266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c137-7632-4f98-80af-ad3e1a798103 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:03.167537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c137-7632-4f98-80af-ad3e1a798103 None admin] PATH_INFO: `/v3/projects/cd4c45dddf5042d2aed9592c053ca7ae` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:03.169213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893c137-7632-4f98-80af-ad3e1a798103 None admin] RBAC: Authorizing `identity:get_project(project_id=cd4c45dddf5042d2aed9592c053ca7ae)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:03.170670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893c137-7632-4f98-80af-ad3e1a798103 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:03.172286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 570/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:02:03 2022] GET /identity/v3/projects/cd4c45dddf5042d2aed9592c053ca7ae => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:03.178417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6b18-0b46-4365-990b-8ad920082228 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:03.244795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:03.273349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6b18-0b46-4365-990b-8ad920082228 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:03.306441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7280e9-98d0-47a9-8af7-5e8502d5f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:03.307025 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7280e9-98d0-47a9-8af7-5e8502d5f1bc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:03.307299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7280e9-98d0-47a9-8af7-5e8502d5f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:03.307563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7280e9-98d0-47a9-8af7-5e8502d5f1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:03.308289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7280e9-98d0-47a9-8af7-5e8502d5f1bc None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=cd4c45dddf5042d2aed9592c053ca7ae, user.id=3e45841080f44026a2464b0f0c4ced50) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:03.308594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7280e9-98d0-47a9-8af7-5e8502d5f1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:03.310027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7280e9-98d0-47a9-8af7-5e8502d5f1bc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:03.315119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 576/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:02:03 2022] GET /identity/v3/role_assignments?user.id=3e45841080f44026a2464b0f0c4ced50&scope.project.id=cd4c45dddf5042d2aed9592c053ca7ae&role.id=c182619b007b495f912901d866e751e1 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:05.431119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8d0c-4fd2-4ff1-87dc-f4eafb0c5337 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:05.431646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8d0c-4fd2-4ff1-87dc-f4eafb0c5337 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:05.431646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e8d0c-4fd2-4ff1-87dc-f4eafb0c5337 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:05.432980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 571/1147] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:05.438638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547878-b338-418c-9103-c1b9d990c946 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:05.439069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547878-b338-418c-9103-c1b9d990c946 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:05.439185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547878-b338-418c-9103-c1b9d990c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:05.457655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5b547878-b338-418c-9103-c1b9d990c946 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:05.458833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5b547878-b338-418c-9103-c1b9d990c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:05.525050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 577/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:02:05.791056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e8d0c-4fd2-4ff1-87dc-f4eafb0c5337 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:05.846664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:05.890844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e8d0c-4fd2-4ff1-87dc-f4eafb0c5337 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:05.923270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b31a74-f9fd-4d9b-bec5-d6450eb7d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:05.923880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b31a74-f9fd-4d9b-bec5-d6450eb7d1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:05.924159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b31a74-f9fd-4d9b-bec5-d6450eb7d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:05.924433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b31a74-f9fd-4d9b-bec5-d6450eb7d1b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:05.934294 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b31a74-f9fd-4d9b-bec5-d6450eb7d1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d8b31a74-f9fd-4d9b-bec5-d6450eb7d1b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:02:05.939077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:02:05.940145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:02:05.941181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 572/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:02:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:02:05.947366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b547878-b338-418c-9103-c1b9d990c946 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:06.009251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:06.043947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b547878-b338-418c-9103-c1b9d990c946 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:06.076594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:06.077184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:06.077501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:06.077776 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:06.078439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:06.078738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:06.080106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:06.087933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 578/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:06.094386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b31a74-f9fd-4d9b-bec5-d6450eb7d1b7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:06.190828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b31a74-f9fd-4d9b-bec5-d6450eb7d1b7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:06.205088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:06.224543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abaaa4-9e50-4e26-9a71-124b2482ea92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:06.225151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abaaa4-9e50-4e26-9a71-124b2482ea92 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:06.225453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abaaa4-9e50-4e26-9a71-124b2482ea92 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:06.225727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abaaa4-9e50-4e26-9a71-124b2482ea92 None admin] PATH_INFO: `/v3/users/3e45841080f44026a2464b0f0c4ced50` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:06.226817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abaaa4-9e50-4e26-9a71-124b2482ea92 None admin] RBAC: Authorizing `identity:get_user(user_id=3e45841080f44026a2464b0f0c4ced50)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:06.228223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abaaa4-9e50-4e26-9a71-124b2482ea92 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:06.229814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 573/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:02:06 2022] GET /identity/v3/users/3e45841080f44026a2464b0f0c4ced50 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:06.235484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:06.332048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92af26-e0f3-48b1-a9e4-65404d0fcf6b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:06.358067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:06.366363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf842b-4e79-449a-a8c1-bbccc7e8d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:06.366979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf842b-4e79-449a-a8c1-bbccc7e8d340 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:06.367261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf842b-4e79-449a-a8c1-bbccc7e8d340 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:06.367533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf842b-4e79-449a-a8c1-bbccc7e8d340 None admin] PATH_INFO: `/v3/projects/cd4c45dddf5042d2aed9592c053ca7ae` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:06.368635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf842b-4e79-449a-a8c1-bbccc7e8d340 None admin] RBAC: Authorizing `identity:get_project(project_id=cd4c45dddf5042d2aed9592c053ca7ae)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:06.370087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf842b-4e79-449a-a8c1-bbccc7e8d340 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:06.371698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 579/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:02:06 2022] GET /identity/v3/projects/cd4c45dddf5042d2aed9592c053ca7ae => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:06.377463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abaaa4-9e50-4e26-9a71-124b2482ea92 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:06.474098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abaaa4-9e50-4e26-9a71-124b2482ea92 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:06.506457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c629b6c-f942-462f-acce-2fe0575e6b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:06.507107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c629b6c-f942-462f-acce-2fe0575e6b94 None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:06.507392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c629b6c-f942-462f-acce-2fe0575e6b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:06.507670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c629b6c-f942-462f-acce-2fe0575e6b94 None admin] PATH_INFO: `/v3/projects/cd4c45dddf5042d2aed9592c053ca7ae/users/3e45841080f44026a2464b0f0c4ced50/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:06.509601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c629b6c-f942-462f-acce-2fe0575e6b94 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c45dddf5042d2aed9592c053ca7ae, user_id=3e45841080f44026a2464b0f0c4ced50, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:06.511029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c629b6c-f942-462f-acce-2fe0575e6b94 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:06.525235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 574/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:02:06 2022] PUT /identity/v3/projects/cd4c45dddf5042d2aed9592c053ca7ae/users/3e45841080f44026a2464b0f0c4ced50/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:02:08.620380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e39d6-d7a5-48b9-9c17-82b0d41a67bb None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:08.621498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e39d6-d7a5-48b9-9c17-82b0d41a67bb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:08.621498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e39d6-d7a5-48b9-9c17-82b0d41a67bb None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:08.622799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 580/1154] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:08.627896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ad426-7d76-4b15-a41a-9e94bf0997a3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:08.628320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ad426-7d76-4b15-a41a-9e94bf0997a3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:08.628453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ad426-7d76-4b15-a41a-9e94bf0997a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:08.647112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-881ad426-7d76-4b15-a41a-9e94bf0997a3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:08.648290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-881ad426-7d76-4b15-a41a-9e94bf0997a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:08.682043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:08.717309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 575/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:08.986835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e39d6-d7a5-48b9-9c17-82b0d41a67bb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:09.098942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e39d6-d7a5-48b9-9c17-82b0d41a67bb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:09.131576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caaafa-8fe0-4de7-a090-c1f03302c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:09.132195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caaafa-8fe0-4de7-a090-c1f03302c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:09.132473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caaafa-8fe0-4de7-a090-c1f03302c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:09.132742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caaafa-8fe0-4de7-a090-c1f03302c1d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:09.143215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caaafa-8fe0-4de7-a090-c1f03302c1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b0caaafa-8fe0-4de7-a090-c1f03302c1d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:02:09.148097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:02:09.149221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:02:09.150505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 581/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:02:09.155800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ad426-7d76-4b15-a41a-9e94bf0997a3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:09.251498 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ad426-7d76-4b15-a41a-9e94bf0997a3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:09.284615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:09.285215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:09.285524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:09.285797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:09.286453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:09.286753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:09.288105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:09.296435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 576/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:09.302408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caaafa-8fe0-4de7-a090-c1f03302c1d2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:09.356660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:09.399748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caaafa-8fe0-4de7-a090-c1f03302c1d2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:09.431149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6daf8-3b45-4044-9c83-932b0602fb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:09.431759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6daf8-3b45-4044-9c83-932b0602fb8d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:09.432034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6daf8-3b45-4044-9c83-932b0602fb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:09.432303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6daf8-3b45-4044-9c83-932b0602fb8d None admin] PATH_INFO: `/v3/users/3e45841080f44026a2464b0f0c4ced50` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:09.433900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6daf8-3b45-4044-9c83-932b0602fb8d None admin] RBAC: Authorizing `identity:get_user(user_id=3e45841080f44026a2464b0f0c4ced50)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:09.435314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6daf8-3b45-4044-9c83-932b0602fb8d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:09.436851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 582/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:02:09 2022] GET /identity/v3/users/3e45841080f44026a2464b0f0c4ced50 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:02:09.442520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:09.475867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:09.540078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e46cf-5dad-458a-8f49-a94b77510221 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:09.572389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8561bec-1b3d-423d-9605-065604e84c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:09.572976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8561bec-1b3d-423d-9605-065604e84c46 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:09.573251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8561bec-1b3d-423d-9605-065604e84c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:09.573549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8561bec-1b3d-423d-9605-065604e84c46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:09.637474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8561bec-1b3d-423d-9605-065604e84c46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:09.639144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8561bec-1b3d-423d-9605-065604e84c46 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:09.670012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:09.732813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 577/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:02:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:02:09.738780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6daf8-3b45-4044-9c83-932b0602fb8d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:09.834799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6daf8-3b45-4044-9c83-932b0602fb8d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:09.857023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:09.867786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0841b-0b01-47ca-9670-b12b01b507e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:09.868386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0841b-0b01-47ca-9670-b12b01b507e7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:09.868667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0841b-0b01-47ca-9670-b12b01b507e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:09.868936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0841b-0b01-47ca-9670-b12b01b507e7 None admin] PATH_INFO: `/v3/projects/cd4c45dddf5042d2aed9592c053ca7ae` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:09.870030 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0841b-0b01-47ca-9670-b12b01b507e7 None admin] RBAC: Authorizing `identity:get_project(project_id=cd4c45dddf5042d2aed9592c053ca7ae)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:09.871971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0841b-0b01-47ca-9670-b12b01b507e7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:09.873585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 583/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:02:09 2022] GET /identity/v3/projects/cd4c45dddf5042d2aed9592c053ca7ae => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:09.879694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8561bec-1b3d-423d-9605-065604e84c46 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:09.975328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8561bec-1b3d-423d-9605-065604e84c46 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:10.007808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0d74-c4f6-4865-a792-9f830367a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:10.008395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0d74-c4f6-4865-a792-9f830367a29a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:10.008675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0d74-c4f6-4865-a792-9f830367a29a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:10.008947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0d74-c4f6-4865-a792-9f830367a29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:10.009687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f0d74-c4f6-4865-a792-9f830367a29a None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=cd4c45dddf5042d2aed9592c053ca7ae, user.id=3e45841080f44026a2464b0f0c4ced50) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:10.009995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f0d74-c4f6-4865-a792-9f830367a29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:10.011990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f0d74-c4f6-4865-a792-9f830367a29a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:10.013721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:10.018883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 578/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:02:09 2022] GET /identity/v3/role_assignments?user.id=3e45841080f44026a2464b0f0c4ced50&scope.project.id=cd4c45dddf5042d2aed9592c053ca7ae&role.id=c182619b007b495f912901d866e751e1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:12.152770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de9c8d-a81f-435b-9e04-939cfc206dc1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:12.153315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de9c8d-a81f-435b-9e04-939cfc206dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:12.153315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de9c8d-a81f-435b-9e04-939cfc206dc1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:12.154672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 584/1162] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:12.159971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a699ec-4412-4bbc-9eb5-321793d387ec None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:12.160383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a699ec-4412-4bbc-9eb5-321793d387ec None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:12.160523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a699ec-4412-4bbc-9eb5-321793d387ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:12.178762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f0a699ec-4412-4bbc-9eb5-321793d387ec None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:12.179926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f0a699ec-4412-4bbc-9eb5-321793d387ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:12.243503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 579/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:12.507719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de9c8d-a81f-435b-9e04-939cfc206dc1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:12.606960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de9c8d-a81f-435b-9e04-939cfc206dc1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:12.639911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9895e6-efd4-4b0c-8b46-73b05bbc42d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:12.640506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9895e6-efd4-4b0c-8b46-73b05bbc42d2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:12.640783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9895e6-efd4-4b0c-8b46-73b05bbc42d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:12.641052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9895e6-efd4-4b0c-8b46-73b05bbc42d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:12.696367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:12.706537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9895e6-efd4-4b0c-8b46-73b05bbc42d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:12.707974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9895e6-efd4-4b0c-8b46-73b05bbc42d2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:12.801763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 585/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:02:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:02:12.807548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a699ec-4412-4bbc-9eb5-321793d387ec None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:12.902007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a699ec-4412-4bbc-9eb5-321793d387ec None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:12.927189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:12.935590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b435b-7a62-40b5-984b-930fc85956a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:12.936200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b435b-7a62-40b5-984b-930fc85956a1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:12.936475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b435b-7a62-40b5-984b-930fc85956a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:12.936743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b435b-7a62-40b5-984b-930fc85956a1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:12.943194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b435b-7a62-40b5-984b-930fc85956a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:12.944606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b435b-7a62-40b5-984b-930fc85956a1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-1f5b435b-7a62-40b5-984b-930fc85956a1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:02:12.955742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:02:12.956749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:02:12.957867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 580/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:02:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:02:12.962639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9895e6-efd4-4b0c-8b46-73b05bbc42d2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:13.050290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:13.059294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9895e6-efd4-4b0c-8b46-73b05bbc42d2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:13.092778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0512-8846-46cf-a591-ef20a74829b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:13.093370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0512-8846-46cf-a591-ef20a74829b5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:13.093681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0512-8846-46cf-a591-ef20a74829b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:13.093953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0512-8846-46cf-a591-ef20a74829b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:13.094590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0512-8846-46cf-a591-ef20a74829b5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:13.094887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0512-8846-46cf-a591-ef20a74829b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:13.096232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0512-8846-46cf-a591-ef20a74829b5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:13.103240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 586/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Sep 8 01:02:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:15.205963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cdb86-32bc-4238-9774-1c4a7436a8a0 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:15.206526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cdb86-32bc-4238-9774-1c4a7436a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:15.206526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cdb86-32bc-4238-9774-1c4a7436a8a0 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:15.207836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 581/1167] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:15.213035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4836-23a7-4f8c-99b9-f93697a648e8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:15.213456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4836-23a7-4f8c-99b9-f93697a648e8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:15.213618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4836-23a7-4f8c-99b9-f93697a648e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:15.232721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ad1c4836-23a7-4f8c-99b9-f93697a648e8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:15.233963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ad1c4836-23a7-4f8c-99b9-f93697a648e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:15.299573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 587/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:15.564310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cdb86-32bc-4238-9774-1c4a7436a8a0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:15.662822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cdb86-32bc-4238-9774-1c4a7436a8a0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:15.695479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c5ac0-1160-407e-b1af-1c14e2807698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:15.696072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5ac0-1160-407e-b1af-1c14e2807698 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:15.696355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5ac0-1160-407e-b1af-1c14e2807698 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:15.696630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c5ac0-1160-407e-b1af-1c14e2807698 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:15.697295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c5ac0-1160-407e-b1af-1c14e2807698 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:15.699207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c5ac0-1160-407e-b1af-1c14e2807698 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:15.715483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 582/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Sep 8 01:02:15 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:02:17.852216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89b48-c544-48b1-ad86-379b53eda49e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:17.852734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89b48-c544-48b1-ad86-379b53eda49e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:17.852734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89b48-c544-48b1-ad86-379b53eda49e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:17.854017 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 588/1170] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:17.859680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f3eb-52ea-42ef-b2cc-156eb298e630 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:17.860056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f3eb-52ea-42ef-b2cc-156eb298e630 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:17.860233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0f3eb-52ea-42ef-b2cc-156eb298e630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:17.878667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-afc0f3eb-52ea-42ef-b2cc-156eb298e630 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:17.879846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-afc0f3eb-52ea-42ef-b2cc-156eb298e630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:17.922080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:17.946104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 583/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:18.212951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d89b48-c544-48b1-ad86-379b53eda49e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:18.296815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:18.312189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d89b48-c544-48b1-ad86-379b53eda49e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:18.344828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8602e2-f1ed-45d0-bcc8-d5523316bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:18.345464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8602e2-f1ed-45d0-bcc8-d5523316bb04 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:18.345746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8602e2-f1ed-45d0-bcc8-d5523316bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:18.346019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8602e2-f1ed-45d0-bcc8-d5523316bb04 None admin] PATH_INFO: `/v3/domains/f5d96739619d46d5bbdef6b3e7f859cf` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:18.356650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8602e2-f1ed-45d0-bcc8-d5523316bb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f5d96739619d46d5bbdef6b3e7f859cf)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:18.358109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8602e2-f1ed-45d0-bcc8-d5523316bb04 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:18.359671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 589/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Sep 8 01:02:18 2022] GET /identity/v3/domains/f5d96739619d46d5bbdef6b3e7f859cf => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:18.365421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f3eb-52ea-42ef-b2cc-156eb298e630 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:18.460867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0f3eb-52ea-42ef-b2cc-156eb298e630 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:18.494429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d5292-cd89-4832-b265-9a169f1cf835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:18.494956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5292-cd89-4832-b265-9a169f1cf835 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:18.495258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5292-cd89-4832-b265-9a169f1cf835 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:18.495530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d5292-cd89-4832-b265-9a169f1cf835 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:18.496182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5292-cd89-4832-b265-9a169f1cf835 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:18.498358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d5292-cd89-4832-b265-9a169f1cf835 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:18.530687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 584/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:02:18 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:02:20.667186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060376f-8668-48ee-867c-8d3e67977fa1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:20.667717 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060376f-8668-48ee-867c-8d3e67977fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:20.667717 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060376f-8668-48ee-867c-8d3e67977fa1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:20.669084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 590/1174] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:20.674518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52da2ae-daf4-4301-a368-4c08349e8572 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:20.674947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52da2ae-daf4-4301-a368-4c08349e8572 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:20.675071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52da2ae-daf4-4301-a368-4c08349e8572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:20.693273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d52da2ae-daf4-4301-a368-4c08349e8572 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:20.694483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d52da2ae-daf4-4301-a368-4c08349e8572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:20.717487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:20.760079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 585/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:21.027013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060376f-8668-48ee-867c-8d3e67977fa1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:21.130548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060376f-8668-48ee-867c-8d3e67977fa1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:21.162637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdd21c-93bd-4ca6-9af2-12b84b0750a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:21.163246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdd21c-93bd-4ca6-9af2-12b84b0750a2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:21.163522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdd21c-93bd-4ca6-9af2-12b84b0750a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:21.163792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdd21c-93bd-4ca6-9af2-12b84b0750a2 None admin] PATH_INFO: `/v3/domains/f5d96739619d46d5bbdef6b3e7f859cf` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:21.164881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdd21c-93bd-4ca6-9af2-12b84b0750a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f5d96739619d46d5bbdef6b3e7f859cf)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:21.166318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdd21c-93bd-4ca6-9af2-12b84b0750a2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:21.168528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 591/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Sep 8 01:02:21 2022] GET /identity/v3/domains/f5d96739619d46d5bbdef6b3e7f859cf => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:21.174327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52da2ae-daf4-4301-a368-4c08349e8572 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:21.268640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52da2ae-daf4-4301-a368-4c08349e8572 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:21.302332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce0a28-2dc1-47b8-902b-0b353ce1089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:21.302859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce0a28-2dc1-47b8-902b-0b353ce1089b None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:21.303131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce0a28-2dc1-47b8-902b-0b353ce1089b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:21.303397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce0a28-2dc1-47b8-902b-0b353ce1089b None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:21.304034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce0a28-2dc1-47b8-902b-0b353ce1089b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:21.305485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce0a28-2dc1-47b8-902b-0b353ce1089b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:21.325736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 586/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:02:21 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:02:23.478172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cbd6d-fc95-4ab0-b27a-9b1ac878004d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:23.478698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cbd6d-fc95-4ab0-b27a-9b1ac878004d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:23.478698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cbd6d-fc95-4ab0-b27a-9b1ac878004d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:23.480041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 592/1178] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:23.485325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660268-503e-445b-af41-4fb74354f366 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:23.485802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660268-503e-445b-af41-4fb74354f366 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:23.485905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660268-503e-445b-af41-4fb74354f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:23.504077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bf660268-503e-445b-af41-4fb74354f366 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:23.505265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bf660268-503e-445b-af41-4fb74354f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:23.516796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:23.572204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 587/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:23.835890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cbd6d-fc95-4ab0-b27a-9b1ac878004d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:23.851673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:23.936924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cbd6d-fc95-4ab0-b27a-9b1ac878004d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:23.968208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a504bf-9dd1-4563-926a-85b7eba26d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:23.968815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a504bf-9dd1-4563-926a-85b7eba26d89 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:23.969090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a504bf-9dd1-4563-926a-85b7eba26d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:23.969358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a504bf-9dd1-4563-926a-85b7eba26d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:23.979415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a504bf-9dd1-4563-926a-85b7eba26d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e6a504bf-9dd1-4563-926a-85b7eba26d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:02:23.984623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:02:23.985720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:02:23.986630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 593/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:02:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:02:23.991665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660268-503e-445b-af41-4fb74354f366 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:24.086296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660268-503e-445b-af41-4fb74354f366 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:24.118845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:24.119438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:24.119715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:24.119982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:24.121202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:24.121567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:24.122914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:24.130629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 588/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:24.136242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a504bf-9dd1-4563-926a-85b7eba26d89 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:24.213285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:24.238461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a504bf-9dd1-4563-926a-85b7eba26d89 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:24.270135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cd164-b4c4-4504-a3ae-9f0022b6d6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:24.270755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd164-b4c4-4504-a3ae-9f0022b6d6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:24.271033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd164-b4c4-4504-a3ae-9f0022b6d6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:24.271305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd164-b4c4-4504-a3ae-9f0022b6d6a7 None admin] PATH_INFO: `/v3/users/33e8db878d8540caa387645b812ca6de` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:24.285323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cd164-b4c4-4504-a3ae-9f0022b6d6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=33e8db878d8540caa387645b812ca6de)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:24.286782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cd164-b4c4-4504-a3ae-9f0022b6d6a7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:24.288348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 594/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:02:24 2022] GET /identity/v3/users/33e8db878d8540caa387645b812ca6de => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:24.294822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:24.305788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:24.390900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ea2f3-16ad-463c-a58f-d849ef6a8d0c None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:24.422955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633f98-68bd-405e-94e2-178b9100dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:24.423546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633f98-68bd-405e-94e2-178b9100dd8e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:24.423828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633f98-68bd-405e-94e2-178b9100dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:24.424099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633f98-68bd-405e-94e2-178b9100dd8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:24.488201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30633f98-68bd-405e-94e2-178b9100dd8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:24.489676 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30633f98-68bd-405e-94e2-178b9100dd8e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:24.499559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:24.587871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 589/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:02:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:02:24.593808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cd164-b4c4-4504-a3ae-9f0022b6d6a7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:24.689310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cd164-b4c4-4504-a3ae-9f0022b6d6a7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:24.716623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:24.721874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237a68f-db24-4ba1-bd3b-f6926d2fd0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:24.722489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a68f-db24-4ba1-bd3b-f6926d2fd0fb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:24.722768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a68f-db24-4ba1-bd3b-f6926d2fd0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:24.723040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a68f-db24-4ba1-bd3b-f6926d2fd0fb None admin] PATH_INFO: `/v3/projects/22852412c7244b4a821d5d35d165776e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:24.724130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237a68f-db24-4ba1-bd3b-f6926d2fd0fb None admin] RBAC: Authorizing `identity:get_project(project_id=22852412c7244b4a821d5d35d165776e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:24.725582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237a68f-db24-4ba1-bd3b-f6926d2fd0fb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:24.727185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 595/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:02:24 2022] GET /identity/v3/projects/22852412c7244b4a821d5d35d165776e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:24.733589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633f98-68bd-405e-94e2-178b9100dd8e None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:24.829321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633f98-68bd-405e-94e2-178b9100dd8e None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:24.838207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:24.862862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ba4a8-f299-421a-83ba-7f1d6b560ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:24.863500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba4a8-f299-421a-83ba-7f1d6b560ceb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:24.863785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba4a8-f299-421a-83ba-7f1d6b560ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:24.864057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ba4a8-f299-421a-83ba-7f1d6b560ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:24.864770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ba4a8-f299-421a-83ba-7f1d6b560ceb None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=22852412c7244b4a821d5d35d165776e, user.id=33e8db878d8540caa387645b812ca6de) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:24.865076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ba4a8-f299-421a-83ba-7f1d6b560ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:24.866530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ba4a8-f299-421a-83ba-7f1d6b560ceb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:24.871737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 590/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:02:24 2022] GET /identity/v3/role_assignments?user.id=33e8db878d8540caa387645b812ca6de&scope.project.id=22852412c7244b4a821d5d35d165776e&role.id=c182619b007b495f912901d866e751e1 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:02:26.988215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f33d-38b0-4dd2-b4fc-9a4ce09b7b7e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:26.988778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f33d-38b0-4dd2-b4fc-9a4ce09b7b7e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:26.988778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f33d-38b0-4dd2-b4fc-9a4ce09b7b7e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:26.990168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 596/1186] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:26.995357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf93976-146c-4b84-b9a9-d744448d1cf7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:26.996276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf93976-146c-4b84-b9a9-d744448d1cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:26.996483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf93976-146c-4b84-b9a9-d744448d1cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:27.015095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3cf93976-146c-4b84-b9a9-d744448d1cf7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:27.016267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3cf93976-146c-4b84-b9a9-d744448d1cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:27.080471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 591/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:27.346525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f33d-38b0-4dd2-b4fc-9a4ce09b7b7e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:27.445985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f33d-38b0-4dd2-b4fc-9a4ce09b7b7e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:27.480070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34ee91-2f46-466c-a3a2-5c5ffc796b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:27.480693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ee91-2f46-466c-a3a2-5c5ffc796b87 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:27.480967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ee91-2f46-466c-a3a2-5c5ffc796b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:27.481229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34ee91-2f46-466c-a3a2-5c5ffc796b87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:27.491041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34ee91-2f46-466c-a3a2-5c5ffc796b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-fd34ee91-2f46-466c-a3a2-5c5ffc796b87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:02:27.495777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:02:27.496841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:02:27.497882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 597/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:02:27.503009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf93976-146c-4b84-b9a9-d744448d1cf7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:27.599251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf93976-146c-4b84-b9a9-d744448d1cf7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:27.600662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:27.632348 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:27.632944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:27.633227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:27.633528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:27.634178 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:27.634479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:27.636361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:27.644310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 592/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:27.650282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34ee91-2f46-466c-a3a2-5c5ffc796b87 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:27.708925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:27.748543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34ee91-2f46-466c-a3a2-5c5ffc796b87 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:27.789124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4c59-cb21-4214-96dc-4e5413e0d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:27.790046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4c59-cb21-4214-96dc-4e5413e0d904 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:27.790461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4c59-cb21-4214-96dc-4e5413e0d904 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:27.790867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4c59-cb21-4214-96dc-4e5413e0d904 None admin] PATH_INFO: `/v3/users/33e8db878d8540caa387645b812ca6de` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:27.792677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4c59-cb21-4214-96dc-4e5413e0d904 None admin] RBAC: Authorizing `identity:get_user(user_id=33e8db878d8540caa387645b812ca6de)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:27.795216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4c59-cb21-4214-96dc-4e5413e0d904 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:27.798036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 598/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:02:27 2022] GET /identity/v3/users/33e8db878d8540caa387645b812ca6de => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:27.804332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:27.905519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2051d0f-2907-4c52-9820-72448ec6d79a None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:27.937769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbbc5-d56e-485e-a1ad-8b2c439f39d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:27.938382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbbc5-d56e-485e-a1ad-8b2c439f39d2 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:27.938657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbbc5-d56e-485e-a1ad-8b2c439f39d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:27.938926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbbc5-d56e-485e-a1ad-8b2c439f39d2 None admin] PATH_INFO: `/v3/projects/22852412c7244b4a821d5d35d165776e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:27.940016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbbc5-d56e-485e-a1ad-8b2c439f39d2 None admin] RBAC: Authorizing `identity:get_project(project_id=22852412c7244b4a821d5d35d165776e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:27.941457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbbc5-d56e-485e-a1ad-8b2c439f39d2 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:27.943068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 593/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:02:27 2022] GET /identity/v3/projects/22852412c7244b4a821d5d35d165776e => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:27.949792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4c59-cb21-4214-96dc-4e5413e0d904 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:28.044831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4c59-cb21-4214-96dc-4e5413e0d904 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:28.070452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:28.079011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbff423-4472-410d-9d02-387f136e003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:28.079650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbff423-4472-410d-9d02-387f136e003e None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:28.079930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbff423-4472-410d-9d02-387f136e003e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:28.080205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbff423-4472-410d-9d02-387f136e003e None admin] PATH_INFO: `/v3/projects/22852412c7244b4a821d5d35d165776e/users/33e8db878d8540caa387645b812ca6de/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:28.082093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbff423-4472-410d-9d02-387f136e003e None admin] RBAC: Authorizing `identity:create_grant(project_id=22852412c7244b4a821d5d35d165776e, user_id=33e8db878d8540caa387645b812ca6de, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:28.083514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbff423-4472-410d-9d02-387f136e003e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:28.095881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 599/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:02:27 2022] PUT /identity/v3/projects/22852412c7244b4a821d5d35d165776e/users/33e8db878d8540caa387645b812ca6de/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:02:30.177779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ee8a-ce47-49c8-92ed-b634c75987c8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:30.178333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ee8a-ce47-49c8-92ed-b634c75987c8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:30.178333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66ee8a-ce47-49c8-92ed-b634c75987c8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:30.179710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 594/1193] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:02:30.185062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a6c2-3aff-4013-8351-3caa867133c4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:30.185460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a6c2-3aff-4013-8351-3caa867133c4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:30.185639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a6c2-3aff-4013-8351-3caa867133c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:30.203251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b4d0a6c2-3aff-4013-8351-3caa867133c4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:02:30.204413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b4d0a6c2-3aff-4013-8351-3caa867133c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:02:30.268246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 600/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:02:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:02:30.533542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66ee8a-ce47-49c8-92ed-b634c75987c8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:30.564267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:30.632993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66ee8a-ce47-49c8-92ed-b634c75987c8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:30.666308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942c87f-7017-4f6b-942f-21cab52de0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:30.666949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c87f-7017-4f6b-942f-21cab52de0fb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:30.667228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c87f-7017-4f6b-942f-21cab52de0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:30.667499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c87f-7017-4f6b-942f-21cab52de0fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:30.677265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942c87f-7017-4f6b-942f-21cab52de0fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-0942c87f-7017-4f6b-942f-21cab52de0fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:02:30.682065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:02:30.683114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:02:30.684279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 595/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:02:30.689173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0a6c2-3aff-4013-8351-3caa867133c4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:30.785456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0a6c2-3aff-4013-8351-3caa867133c4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:30.802355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:30.820437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:30.821028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:30.821301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:30.821602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:30.822255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:30.822553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:30.823900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:30.831734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 601/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:30.837544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942c87f-7017-4f6b-942f-21cab52de0fb None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:30.926251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:30.935678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942c87f-7017-4f6b-942f-21cab52de0fb None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:30.968417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde3e5-c5bc-4a47-8725-424948e407ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:30.969024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde3e5-c5bc-4a47-8725-424948e407ea None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:30.969306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde3e5-c5bc-4a47-8725-424948e407ea None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:30.969613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde3e5-c5bc-4a47-8725-424948e407ea None admin] PATH_INFO: `/v3/users/33e8db878d8540caa387645b812ca6de` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:30.970721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcde3e5-c5bc-4a47-8725-424948e407ea None admin] RBAC: Authorizing `identity:get_user(user_id=33e8db878d8540caa387645b812ca6de)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:30.972158 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcde3e5-c5bc-4a47-8725-424948e407ea None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:30.973740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 596/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Sep 8 01:02:30 2022] GET /identity/v3/users/33e8db878d8540caa387645b812ca6de => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:30.979433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:31.074549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432cbe1-db08-49e2-a4ec-dd9664a80bd9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:31.106714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9d144-a815-4cd8-8f94-ce16ea24b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:31.107286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d144-a815-4cd8-8f94-ce16ea24b946 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:31.107561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d144-a815-4cd8-8f94-ce16ea24b946 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:31.107826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d144-a815-4cd8-8f94-ce16ea24b946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:31.153336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:31.172560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9d144-a815-4cd8-8f94-ce16ea24b946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:31.174037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9d144-a815-4cd8-8f94-ce16ea24b946 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:31.267056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 602/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:02:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:02:31.272927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde3e5-c5bc-4a47-8725-424948e407ea None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:31.374268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde3e5-c5bc-4a47-8725-424948e407ea None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:31.408149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dbee1-9920-4587-a5ee-89819cb1bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:31.408771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dbee1-9920-4587-a5ee-89819cb1bd76 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:31.409052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dbee1-9920-4587-a5ee-89819cb1bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:31.409327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dbee1-9920-4587-a5ee-89819cb1bd76 None admin] PATH_INFO: `/v3/projects/22852412c7244b4a821d5d35d165776e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:31.410474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dbee1-9920-4587-a5ee-89819cb1bd76 None admin] RBAC: Authorizing `identity:get_project(project_id=22852412c7244b4a821d5d35d165776e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:31.411918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dbee1-9920-4587-a5ee-89819cb1bd76 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:31.413559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 597/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Sep 8 01:02:31 2022] GET /identity/v3/projects/22852412c7244b4a821d5d35d165776e => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:31.420129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9d144-a815-4cd8-8f94-ce16ea24b946 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:02:31.496902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:31.516106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9d144-a815-4cd8-8f94-ce16ea24b946 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:02:31.549393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103ac77-f70e-4c4d-a199-9f701985df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:02:31.550003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ac77-f70e-4c4d-a199-9f701985df1d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:02:31.550279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ac77-f70e-4c4d-a199-9f701985df1d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:02:31.550548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ac77-f70e-4c4d-a199-9f701985df1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:02:31.551253 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103ac77-f70e-4c4d-a199-9f701985df1d None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=22852412c7244b4a821d5d35d165776e, user.id=33e8db878d8540caa387645b812ca6de) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:02:31.551553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103ac77-f70e-4c4d-a199-9f701985df1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:02:31.552953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103ac77-f70e-4c4d-a199-9f701985df1d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:02:31.559126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 603/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:02:31 2022] GET /identity/v3/role_assignments?user.id=33e8db878d8540caa387645b812ca6de&scope.project.id=22852412c7244b4a821d5d35d165776e&role.id=c182619b007b495f912901d866e751e1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:02:41.404061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=86 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:02:41.556042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=28 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:26.664982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3b0a-3e68-49e5-a149-446d1920c0c6 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:26.664982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3b0a-3e68-49e5-a149-446d1920c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:26.664982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3b0a-3e68-49e5-a149-446d1920c0c6 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:26.666156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 598/1201] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:03:26.671900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d86373-8c53-4085-850f-84783d697c9c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:26.672813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d86373-8c53-4085-850f-84783d697c9c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:26.672813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d86373-8c53-4085-850f-84783d697c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:26.691658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a0d86373-8c53-4085-850f-84783d697c9c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:03:26.692887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a0d86373-8c53-4085-850f-84783d697c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:03:26.783507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 604/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:03:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:03:27.054107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b3b0a-3e68-49e5-a149-446d1920c0c6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:27.187877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b3b0a-3e68-49e5-a149-446d1920c0c6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:27.231968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:27.233347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:27.233872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:27.234323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:27.246935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:27.249002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:27.268803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:27.270207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:27.271496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:27.271496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:27.271496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:27.278906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 599/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:27.280143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d86373-8c53-4085-850f-84783d697c9c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:27.404509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d86373-8c53-4085-850f-84783d697c9c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:27.441201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:27.448459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442e28-18a1-40a2-b5c5-c57f9b46bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:27.449216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442e28-18a1-40a2-b5c5-c57f9b46bfbb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:27.449624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442e28-18a1-40a2-b5c5-c57f9b46bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:27.450023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442e28-18a1-40a2-b5c5-c57f9b46bfbb None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:27.450769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75442e28-18a1-40a2-b5c5-c57f9b46bfbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:27.451200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75442e28-18a1-40a2-b5c5-c57f9b46bfbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:27.456897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75442e28-18a1-40a2-b5c5-c57f9b46bfbb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:27.484632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 605/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:27.485845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:27.555207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:27.615477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085c9ab-a7fd-462f-8c00-57a750b55dba None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:27.673011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e96360-4110-4e3b-9011-03d0010b21e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:27.673673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e96360-4110-4e3b-9011-03d0010b21e0 None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:27.673863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e96360-4110-4e3b-9011-03d0010b21e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:27.674141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e96360-4110-4e3b-9011-03d0010b21e0 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:27.674796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e96360-4110-4e3b-9011-03d0010b21e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:27.676241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e96360-4110-4e3b-9011-03d0010b21e0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:27.705449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 600/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Sep 8 01:03:27 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:03:30.129146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57af6-047a-40b5-8cc1-61c72e0e8313 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:30.129709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57af6-047a-40b5-8cc1-61c72e0e8313 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:30.129821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57af6-047a-40b5-8cc1-61c72e0e8313 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:30.131119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 606/1206] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:03:30.137249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d702769-0388-4ef4-a089-b5106698d377 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:30.137249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d702769-0388-4ef4-a089-b5106698d377 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:30.137801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d702769-0388-4ef4-a089-b5106698d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:30.159521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9d702769-0388-4ef4-a089-b5106698d377 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:03:30.159845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9d702769-0388-4ef4-a089-b5106698d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:03:30.238311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 601/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:03:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:03:30.539787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d57af6-047a-40b5-8cc1-61c72e0e8313 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:30.668623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d57af6-047a-40b5-8cc1-61c72e0e8313 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:30.711703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2ceb4-b216-4c0a-ba59-1c028da5b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:30.713029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2ceb4-b216-4c0a-ba59-1c028da5b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:30.713445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2ceb4-b216-4c0a-ba59-1c028da5b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:30.713822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2ceb4-b216-4c0a-ba59-1c028da5b9f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:30.725155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2ceb4-b216-4c0a-ba59-1c028da5b9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4ad2ceb4-b216-4c0a-ba59-1c028da5b9f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:03:30.730900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:30.732591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:03:30.733888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:30.738000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 607/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:03:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:30.740872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d702769-0388-4ef4-a089-b5106698d377 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:30.792644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:30.861392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d702769-0388-4ef4-a089-b5106698d377 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:30.910778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:30.911625 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:30.911952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:30.912210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:30.912927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:30.913260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:30.916048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:30.926606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 602/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:03:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:30.933254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2ceb4-b216-4c0a-ba59-1c028da5b9f8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:30.998037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:31.061021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2ceb4-b216-4c0a-ba59-1c028da5b9f8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:31.100047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:31.100944 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:31.101159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:31.101546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:31.113971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:31.115444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:31.134302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:31.136261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:31.137384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:31.137384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:31.137384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:31.141520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 608/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:03:31.144109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:31.254942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:31.260783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63175e10-32dc-49a4-9e60-592b2ba61d6b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:31.302271 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:31.303640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:31.303750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:31.303960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:31.304587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:31.304885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:31.306392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:31.318959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 603/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:03:31.325105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:31.455067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f551c41-699e-4af1-a4da-57e7e6d30aa9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:31.456922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:31.497136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:31.498283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:31.498661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:31.499126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:31.509994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:31.511537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:03:31.527376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:31.528589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:31.529797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:31.531485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 609/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 01:03:31.537970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:31.657751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cd978-a375-4c07-b974-29a600cf1039 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:31.695224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:31.695823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:31.696097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:31.696451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:31.697263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:31.697546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:31.699285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:31.717334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 604/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 8 01:03:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:31.723190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:31.844836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ee97-fc36-4041-86c8-0c2a7cedb09b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:31.890655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06893f36-dc55-47e1-85cf-4fff176eab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:31.891588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893f36-dc55-47e1-85cf-4fff176eab88 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:31.892073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893f36-dc55-47e1-85cf-4fff176eab88 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:31.892582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893f36-dc55-47e1-85cf-4fff176eab88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:31.932149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:31.980990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06893f36-dc55-47e1-85cf-4fff176eab88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:31.982675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06893f36-dc55-47e1-85cf-4fff176eab88 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:32.099678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 610/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:03:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:03:32.106189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:32.131683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:32.239634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207dbf-adb7-420e-84b1-9e41598a0130 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:32.284148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:32.284968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:32.285497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:32.285889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:32.299654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:32.301369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:32.319308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:32.320537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:32.321786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:32.321786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:32.321786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:32.325659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 605/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:32.326982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06893f36-dc55-47e1-85cf-4fff176eab88 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:32.402681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:32.460395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06893f36-dc55-47e1-85cf-4fff176eab88 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:32.518561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:32.519436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:32.519870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:32.520152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:32.520984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:32.521295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:32.523273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:32.545021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 611/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:03:32.546592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:32.652241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:32.686632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff62d37-56c4-4384-9e43-f98e1ad8b779 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:32.721649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:32.722274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:32.722554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:32.722831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:32.730397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:32.731920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:03:32.744022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:32.745143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:32.746224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 606/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:32.751571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:32.885276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd62b-376c-4e2d-808a-212804aa81b1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:32.918943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:32.934180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d5f9-1f50-4595-a3c6-cdd67b206b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:32.935038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d5f9-1f50-4595-a3c6-cdd67b206b4a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:32.935476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d5f9-1f50-4595-a3c6-cdd67b206b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:32.935931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d5f9-1f50-4595-a3c6-cdd67b206b4a None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:32.936840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d5f9-1f50-4595-a3c6-cdd67b206b4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:32.937307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d5f9-1f50-4595-a3c6-cdd67b206b4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:32.939520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d5f9-1f50-4595-a3c6-cdd67b206b4a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:32.955267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 612/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:32.961442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:33.075262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae7817-9f05-4ef6-9757-130e8878c8f7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:33.104538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:33.110976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698cc1e-cbde-4b37-b33f-43113c6e05eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:33.111574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cc1e-cbde-4b37-b33f-43113c6e05eb None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:33.111896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cc1e-cbde-4b37-b33f-43113c6e05eb None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:33.112121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698cc1e-cbde-4b37-b33f-43113c6e05eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:33.112839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698cc1e-cbde-4b37-b33f-43113c6e05eb None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=e7e636a8e4704971ae840035f3fc4e01) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:33.113147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698cc1e-cbde-4b37-b33f-43113c6e05eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:33.114612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698cc1e-cbde-4b37-b33f-43113c6e05eb None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:33.120550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 607/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:03:32 2022] GET /identity/v3/role_assignments?user.id=e7e636a8e4704971ae840035f3fc4e01&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:35.241396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a0ae5-c32a-47e3-8f0f-3c472814e90d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:35.242095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a0ae5-c32a-47e3-8f0f-3c472814e90d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:35.242242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a0ae5-c32a-47e3-8f0f-3c472814e90d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:35.244503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 613/1220] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:03:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:03:35.251163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c970-8a84-4e2a-9827-6aa573756880 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:35.251654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c970-8a84-4e2a-9827-6aa573756880 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:35.251800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4c970-8a84-4e2a-9827-6aa573756880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:35.275061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-92c4c970-8a84-4e2a-9827-6aa573756880 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:03:35.276407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-92c4c970-8a84-4e2a-9827-6aa573756880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:03:35.348570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 608/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:03:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:03:35.667261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a0ae5-c32a-47e3-8f0f-3c472814e90d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:35.798189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a0ae5-c32a-47e3-8f0f-3c472814e90d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:35.835340 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33104e-a9c3-43d4-8102-ce8883f77472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:35.835935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33104e-a9c3-43d4-8102-ce8883f77472 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:35.836273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33104e-a9c3-43d4-8102-ce8883f77472 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:35.836521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33104e-a9c3-43d4-8102-ce8883f77472 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:35.847303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33104e-a9c3-43d4-8102-ce8883f77472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ab33104e-a9c3-43d4-8102-ce8883f77472 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:03:35.852098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:35.853327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:35.854386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 614/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:03:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:35.859361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4c970-8a84-4e2a-9827-6aa573756880 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:35.994160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4c970-8a84-4e2a-9827-6aa573756880 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:36.023065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:36.035715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:36.036453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:36.036865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:36.037147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:36.037878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:36.038181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:36.039855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:36.049163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 609/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:03:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:03:36.056171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33104e-a9c3-43d4-8102-ce8883f77472 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:36.103672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:36.163077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33104e-a9c3-43d4-8102-ce8883f77472 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:36.199186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:36.199820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:36.200097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:36.200375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:36.210783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:36.212719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:36.227212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:36.229062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:36.230226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:36.230226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:36.230226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:36.230226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 615/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:36.234878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:36.351139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecfc85-cae9-4432-8003-aefb7ddabed1 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:36.386057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:36.386660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:36.386944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:36.387328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:36.388085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:36.388483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:36.390145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:36.404160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 610/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:36.410218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:36.515477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:36.522907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62549a6b-1e60-4711-9b23-db2947439bd2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:36.559244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:36.559871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:36.560149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:36.560428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:36.568082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:36.569556 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:03:36.583411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:36.584645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:36.585852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 616/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:36.591091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:36.641871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:36.697342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d1696-f3d7-4017-852d-15164da9b8a9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:36.738809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:36.739553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:36.739819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:36.740098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:36.740973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:36.741322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:36.743115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:36.765998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 611/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 8 01:03:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:36.772109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:36.885712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c2ed-4a5a-468f-b8fa-c31fb36872ad None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:36.928162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:36.928714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:36.928993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:36.929256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:36.942296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:36.944398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:36.964998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:36.966527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:36.967814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:36.967814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:36.967814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:36.967814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 617/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:36.972102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:37.090976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec003faf-ce64-4fcc-a5e0-d4ce524a7e5f None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:37.094318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:37.127231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:37.127830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:37.128109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:37.128443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:37.129019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:37.129328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:37.130726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:37.142651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 612/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:03:37.149242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:37.160388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:37.263235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fabe3-5e3b-4893-993a-2dcd758f43e0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:37.300609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:37.301231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:37.301543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:37.301816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:37.309343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:37.310954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:03:37.323920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:37.325041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:37.326386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:03:37.326386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:03:37.326386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:03:37.326386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:03:37.326386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:03:37.326386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:03:37.326386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:37.326386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:37.330510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 618/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:37.331409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:37.444461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36b3ba-c0d8-4232-a7e7-b0530e7ead68 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:37.481653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c50d28-dce7-4a8c-ad54-45b4af65455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:37.482464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c50d28-dce7-4a8c-ad54-45b4af65455f None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:37.482693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c50d28-dce7-4a8c-ad54-45b4af65455f None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:37.483020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c50d28-dce7-4a8c-ad54-45b4af65455f None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:37.483940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c50d28-dce7-4a8c-ad54-45b4af65455f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:37.484267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c50d28-dce7-4a8c-ad54-45b4af65455f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:37.486089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c50d28-dce7-4a8c-ad54-45b4af65455f None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:37.501117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 613/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:03:37.507304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:37.588328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:37.629469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623760-ee3c-4a70-9128-feb4a33cd1b5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:37.666648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5a9d-63fe-4d75-8087-c3c1912f2f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:37.667311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5a9d-63fe-4d75-8087-c3c1912f2f14 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:37.667588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5a9d-63fe-4d75-8087-c3c1912f2f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:37.667864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5a9d-63fe-4d75-8087-c3c1912f2f14 None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/e7e636a8e4704971ae840035f3fc4e01/roles/2c6f5ddd2cca40019b4efa72a509dfd2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:37.682975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5a9d-63fe-4d75-8087-c3c1912f2f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=e7e636a8e4704971ae840035f3fc4e01, role_id=2c6f5ddd2cca40019b4efa72a509dfd2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:37.684416 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5a9d-63fe-4d75-8087-c3c1912f2f14 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:37.702062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 619/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:03:37 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/e7e636a8e4704971ae840035f3fc4e01/roles/2c6f5ddd2cca40019b4efa72a509dfd2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:03:40.013993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56626c-cc21-4bc6-aed5-e8407cb7a5d8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:40.014875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56626c-cc21-4bc6-aed5-e8407cb7a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:40.014875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56626c-cc21-4bc6-aed5-e8407cb7a5d8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:40.016130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 614/1233] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:03:40.021385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3020-6a47-416e-bfa2-2c8fcbf49ed9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:40.021854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3020-6a47-416e-bfa2-2c8fcbf49ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:40.021954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3020-6a47-416e-bfa2-2c8fcbf49ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:40.041630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f67a3020-6a47-416e-bfa2-2c8fcbf49ed9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:03:40.042868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f67a3020-6a47-416e-bfa2-2c8fcbf49ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:03:40.121348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 620/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:03:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:03:40.428290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56626c-cc21-4bc6-aed5-e8407cb7a5d8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:40.458400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:40.554859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56626c-cc21-4bc6-aed5-e8407cb7a5d8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:40.594474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72074d32-b064-4060-9a64-78cafd6fcf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:40.595178 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72074d32-b064-4060-9a64-78cafd6fcf57 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:40.595496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72074d32-b064-4060-9a64-78cafd6fcf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:40.595931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72074d32-b064-4060-9a64-78cafd6fcf57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:40.608183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72074d32-b064-4060-9a64-78cafd6fcf57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-72074d32-b064-4060-9a64-78cafd6fcf57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:03:40.613419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:40.621086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:40.622270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 615/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Sep 8 01:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:40.623247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a3020-6a47-416e-bfa2-2c8fcbf49ed9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:40.675063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:40.728173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a3020-6a47-416e-bfa2-2c8fcbf49ed9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:40.764998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:40.765638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:40.766751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:40.766751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:40.767041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:40.767135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:40.768463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:40.776814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 621/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Sep 8 01:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:40.783474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72074d32-b064-4060-9a64-78cafd6fcf57 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:40.891251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:40.911336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72074d32-b064-4060-9a64-78cafd6fcf57 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:40.955342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:40.956115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:40.956437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:40.956798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:40.967743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:40.969361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:40.985904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:40.986924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:40.987814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:40.987814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:40.987814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:40.987814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 616/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:40.994208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:41.112660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cc1d0-d679-46f6-899d-c1cae9deef1a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:41.123328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:41.150620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:41.151236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:41.151540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:41.151793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:41.152442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:41.152748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:41.154231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:41.167655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 622/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:41.174820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:41.289492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521cac-8711-4442-b8ed-c7c00a02605b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:41.331281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:41.331900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:41.332181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:41.332452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:41.335177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:41.340892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:41.342380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:03:41.355640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:41.356598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:41.358355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 617/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:41.363213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:41.473586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7fcdd-11f8-40dd-a124-d9fa7ad2ff91 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:41.511246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:41.511888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:41.514763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:41.514763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:41.514763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:41.514763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:41.515168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:41.533160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 623/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 8 01:03:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:03:41.539480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:41.668772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e06ab7-1c64-45fa-a5e0-5a8d780f7c22 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:41.714779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855a39a-e6e1-499a-a488-1ef9d58a76ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:41.715697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855a39a-e6e1-499a-a488-1ef9d58a76ab None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:41.716147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855a39a-e6e1-499a-a488-1ef9d58a76ab None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:41.716468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855a39a-e6e1-499a-a488-1ef9d58a76ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:41.792198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:41.801997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855a39a-e6e1-499a-a488-1ef9d58a76ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:41.803631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855a39a-e6e1-499a-a488-1ef9d58a76ab None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:41.924318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 618/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:03:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 01:03:41.930735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:41.966173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:42.057784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd895-f642-4255-a8ed-8b2bb84ac919 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:42.098415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:42.099179 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:42.099531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:42.100061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:42.111999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:42.114329 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:42.131504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:42.133188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:42.134984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:42.134984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:42.134984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:42.137596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 624/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:42.139374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855a39a-e6e1-499a-a488-1ef9d58a76ab None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:42.247872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:42.254394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855a39a-e6e1-499a-a488-1ef9d58a76ab None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:42.292546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:42.293564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:42.293984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:42.294334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:42.295339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:42.295753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:42.297137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:42.309456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 619/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:03:42.315616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:42.408236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:42.433575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ebc61-3df1-486a-910a-486049b93d8f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:42.470560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:42.471231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:42.471544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:42.471863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:42.479648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:42.481393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:03:42.495680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:42.496778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:42.502976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 625/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:42.506119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:42.624545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd2d55-1eac-4cdf-a199-7c6d57b18ef9 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:42.662166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183537f1-9f22-49f6-93a3-4358c407ebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:42.662783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183537f1-9f22-49f6-93a3-4358c407ebc0 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:42.663049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183537f1-9f22-49f6-93a3-4358c407ebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:42.663322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183537f1-9f22-49f6-93a3-4358c407ebc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:42.664012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183537f1-9f22-49f6-93a3-4358c407ebc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:42.664319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183537f1-9f22-49f6-93a3-4358c407ebc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:42.665877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183537f1-9f22-49f6-93a3-4358c407ebc0 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:42.682148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 620/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:42.689277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:42.802839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4246a-6e2a-48c3-b3d2-c4145a45cf2b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:42.841465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efaaf9-42d6-4aa7-98af-9d94547dbe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:42.842112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efaaf9-42d6-4aa7-98af-9d94547dbe3e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:42.842386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efaaf9-42d6-4aa7-98af-9d94547dbe3e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:42.842682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efaaf9-42d6-4aa7-98af-9d94547dbe3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:42.843486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efaaf9-42d6-4aa7-98af-9d94547dbe3e None admin] RBAC: Adding query filter params (role.id=2c6f5ddd2cca40019b4efa72a509dfd2, scope.project.id=454105f786874ed1b407da41aef24389, user.id=e7e636a8e4704971ae840035f3fc4e01) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:42.843814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efaaf9-42d6-4aa7-98af-9d94547dbe3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:42.845535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efaaf9-42d6-4aa7-98af-9d94547dbe3e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:42.852610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 626/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:03:42 2022] GET /identity/v3/role_assignments?user.id=e7e636a8e4704971ae840035f3fc4e01&scope.project.id=454105f786874ed1b407da41aef24389&role.id=2c6f5ddd2cca40019b4efa72a509dfd2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:45.295595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f152a-2627-44a6-bba9-591b25daa6e4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:45.296124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f152a-2627-44a6-bba9-591b25daa6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:45.296124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f152a-2627-44a6-bba9-591b25daa6e4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:45.297769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 621/1247] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:03:45.306339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac91a-9270-402d-8aa7-e1005f9f7a17 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:45.306848 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac91a-9270-402d-8aa7-e1005f9f7a17 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:45.306957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac91a-9270-402d-8aa7-e1005f9f7a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:45.313670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:45.329172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-53cac91a-9270-402d-8aa7-e1005f9f7a17 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:03:45.330517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-53cac91a-9270-402d-8aa7-e1005f9f7a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:03:45.411420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 627/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:03:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:03:45.704714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f152a-2627-44a6-bba9-591b25daa6e4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:45.725682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:45.816397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f152a-2627-44a6-bba9-591b25daa6e4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:45.854935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee96a-2ffc-41cb-8173-a6209e1d53cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:45.855817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee96a-2ffc-41cb-8173-a6209e1d53cd None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:45.856092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee96a-2ffc-41cb-8173-a6209e1d53cd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:45.856359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee96a-2ffc-41cb-8173-a6209e1d53cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:45.870777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee96a-2ffc-41cb-8173-a6209e1d53cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fc5ee96a-2ffc-41cb-8173-a6209e1d53cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:03:45.877219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:45.878397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:45.879402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 622/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:03:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:45.885978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac91a-9270-402d-8aa7-e1005f9f7a17 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:46.003596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac91a-9270-402d-8aa7-e1005f9f7a17 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:46.035688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:46.041224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:46.041897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:46.042175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:46.042446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:46.043119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:46.043420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:46.044801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:46.053961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 628/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:03:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:03:46.060430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee96a-2ffc-41cb-8173-a6209e1d53cd None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:46.142149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:46.166034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee96a-2ffc-41cb-8173-a6209e1d53cd None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:46.202222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:46.202850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:46.203127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:46.203393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:46.213893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:46.215348 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:46.230525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:46.231710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:46.232607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:46.232607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:46.232607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:46.232607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 623/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:46.237658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:46.345021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55364663-de6c-46d8-a8e6-27912ab156c6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:46.381008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:46.381647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:46.381940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:46.382191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:46.382829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:46.383127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:46.384524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:46.397822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 629/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:46.403448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:46.504666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b8d2-900e-43aa-a0be-a280808d4ed4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:46.531611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:46.540398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:46.541016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:46.541291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:46.541590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:46.549091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:46.550558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:03:46.561759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:46.562882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:46.564194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 624/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:46.568657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:46.627853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:46.672822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79eff6-09c4-43e6-a680-2f7c64479f39 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:46.705723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:46.706318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:46.706595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:46.706866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:46.707580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:46.707880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:46.709285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:46.725462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 630/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 8 01:03:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:46.732233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:46.829119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc952d55-d7ec-42ea-b010-47410e36f916 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:46.860755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027b47-2eeb-4ed9-aee9-cc4ccb2c92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:46.861338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027b47-2eeb-4ed9-aee9-cc4ccb2c92a7 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:46.861673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027b47-2eeb-4ed9-aee9-cc4ccb2c92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:46.861948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027b47-2eeb-4ed9-aee9-cc4ccb2c92a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:46.928740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:46.941791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d027b47-2eeb-4ed9-aee9-cc4ccb2c92a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:46.943244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d027b47-2eeb-4ed9-aee9-cc4ccb2c92a7 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:47.037913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 625/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:03:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 01:03:47.043938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:47.138830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d3d1c-7973-4083-8abe-e96d13f6cbd1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:47.152146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:47.173198 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:47.173835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:47.174112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:47.174381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:47.184026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:47.185393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:47.199885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:47.200982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:47.202118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:47.202118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:47.202118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:47.202118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 631/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:47.206694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027b47-2eeb-4ed9-aee9-cc4ccb2c92a7 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:47.290087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:47.301801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027b47-2eeb-4ed9-aee9-cc4ccb2c92a7 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:47.334180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:47.334767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:47.335043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:47.335314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:47.335940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:47.336238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:47.338172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:47.348864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 626/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:47.354492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:47.451224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b54d7-0ab9-47e0-987c-67e2936fb5f0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:47.482414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:47.483018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:47.483298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:47.483566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:47.489879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:47.491291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:03:47.502641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:47.503632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:47.504500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 632/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:47.510081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:47.605901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930a6e-aa74-43ec-9103-8b85fc151d52 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:47.638623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4148fb-8e87-48bb-8ce3-b2e94c963bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:47.639211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4148fb-8e87-48bb-8ce3-b2e94c963bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:47.639489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4148fb-8e87-48bb-8ce3-b2e94c963bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:47.640024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4148fb-8e87-48bb-8ce3-b2e94c963bf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:47.640701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4148fb-8e87-48bb-8ce3-b2e94c963bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:47.641006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4148fb-8e87-48bb-8ce3-b2e94c963bf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:47.642452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4148fb-8e87-48bb-8ce3-b2e94c963bf1 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:47.653941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 627/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:47.659784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:47.685614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:47.757247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5c455-0545-4a0e-925f-4523f8f8c27d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:47.790039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0354a0-841d-47d6-aaa8-8455fbcd7083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:47.790625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0354a0-841d-47d6-aaa8-8455fbcd7083 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:47.790899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0354a0-841d-47d6-aaa8-8455fbcd7083 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:47.791162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0354a0-841d-47d6-aaa8-8455fbcd7083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:47.791868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0354a0-841d-47d6-aaa8-8455fbcd7083 None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=454105f786874ed1b407da41aef24389, user.id=e7e636a8e4704971ae840035f3fc4e01) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:47.792170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0354a0-841d-47d6-aaa8-8455fbcd7083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:47.793609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0354a0-841d-47d6-aaa8-8455fbcd7083 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:47.798839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 633/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:03:47 2022] GET /identity/v3/role_assignments?user.id=e7e636a8e4704971ae840035f3fc4e01&scope.project.id=454105f786874ed1b407da41aef24389&role.id=c182619b007b495f912901d866e751e1 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:49.919966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a83b9-dbdd-4c12-8aca-48310e92c54a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:49.920505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a83b9-dbdd-4c12-8aca-48310e92c54a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:49.920505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a83b9-dbdd-4c12-8aca-48310e92c54a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:49.921921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 628/1261] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:03:49.927277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8105-2b88-430a-9326-b6253be69932 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:49.927662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8105-2b88-430a-9326-b6253be69932 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:49.927819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8105-2b88-430a-9326-b6253be69932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:49.947905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b05e8105-2b88-430a-9326-b6253be69932 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:03:49.949198 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b05e8105-2b88-430a-9326-b6253be69932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:03:50.015743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 634/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:03:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 01:03:50.281017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a83b9-dbdd-4c12-8aca-48310e92c54a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:50.291813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:50.399486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a83b9-dbdd-4c12-8aca-48310e92c54a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:50.438552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b37ad-ef77-4884-9ab2-27c0d6117b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:50.439210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b37ad-ef77-4884-9ab2-27c0d6117b18 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:50.439489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b37ad-ef77-4884-9ab2-27c0d6117b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:50.439764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b37ad-ef77-4884-9ab2-27c0d6117b18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:50.450399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b37ad-ef77-4884-9ab2-27c0d6117b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-221b37ad-ef77-4884-9ab2-27c0d6117b18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:03:50.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:50.456238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:50.457113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 629/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:50.462345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e8105-2b88-430a-9326-b6253be69932 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:50.480337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:50.560296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e8105-2b88-430a-9326-b6253be69932 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:50.592789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:50.593378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:50.593682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:50.593947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:50.594590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:50.594884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:50.596228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:50.604098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 635/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:50.609770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b37ad-ef77-4884-9ab2-27c0d6117b18 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:50.674534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:50.707995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b37ad-ef77-4884-9ab2-27c0d6117b18 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:50.744761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:50.745375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:50.745684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:50.745951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:50.755661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:50.757085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:50.772231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:50.773322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:50.774230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:50.774230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:50.774230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:50.774230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 630/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:50.779274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:50.859603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:50.882449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde4648-3c1d-43b8-8c5e-cc137c61ad7e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:50.917084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:50.917718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:50.917998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:50.918268 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:50.918903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:50.919204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:50.920586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:50.932457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 636/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:50.938290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:51.035064 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56b202-5ac3-49d0-a963-2ba6ddf80e0b None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:51.054356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:51.068963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:51.069643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:51.069927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:51.070201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:51.079287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:51.080729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:03:51.093426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:51.094525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:51.095671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 631/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:51.100499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:51.197470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fb22d-cd89-4102-9c52-29f16fb728c6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:51.230839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:51.231433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:51.231714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:51.231987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:51.232704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:51.233007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:51.234455 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:51.242873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:51.251348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 637/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 8 01:03:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:51.257044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:51.355783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1a083-5c58-4b1b-861f-b3e3dfdc6b6d None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:51.387188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:51.387794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:51.388068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:51.388337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:51.400395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:51.401872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:51.417459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:51.418579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:51.419576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:51.419576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:51.419576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:51.419576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 632/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:51.424287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:51.521207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac2ac-741f-4d66-827b-0162132968cb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:51.554444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:51.555049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:51.555324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:51.555593 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:51.556222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:51.556519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:51.557918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:51.568764 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 638/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:51.574874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:51.606175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:51.673330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e77a2-6b4d-4368-907a-48e32ac28992 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:51.710614 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:51.711845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:51.712126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:51.712399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:51.719128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:51.720547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:03:51.731535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:51.732582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:51.737852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 633/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:51.738459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:51.795140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:51.837562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82fd5c-93e3-4b32-8810-c21b040d101a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:51.871279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cabb55-8f03-4033-bc2e-ec8a0aa1771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:51.871879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabb55-8f03-4033-bc2e-ec8a0aa1771b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:51.872181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabb55-8f03-4033-bc2e-ec8a0aa1771b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:51.872439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabb55-8f03-4033-bc2e-ec8a0aa1771b None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:51.873130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cabb55-8f03-4033-bc2e-ec8a0aa1771b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:51.873424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cabb55-8f03-4033-bc2e-ec8a0aa1771b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:51.874857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cabb55-8f03-4033-bc2e-ec8a0aa1771b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:51.889422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 639/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:51.898190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:51.986205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:51.995548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463facd-3412-48c6-9dda-5e76d90887a5 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:52.034028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993cb87-afec-49c7-b86c-17ea56ebcbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:52.034883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993cb87-afec-49c7-b86c-17ea56ebcbcd None admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:52.035164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993cb87-afec-49c7-b86c-17ea56ebcbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:52.035439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993cb87-afec-49c7-b86c-17ea56ebcbcd None admin] PATH_INFO: `/v3/projects/454105f786874ed1b407da41aef24389/users/e7e636a8e4704971ae840035f3fc4e01/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:52.037323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993cb87-afec-49c7-b86c-17ea56ebcbcd None admin] RBAC: Authorizing `identity:create_grant(project_id=454105f786874ed1b407da41aef24389, user_id=e7e636a8e4704971ae840035f3fc4e01, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:52.038784 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993cb87-afec-49c7-b86c-17ea56ebcbcd None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:52.053884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 634/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Sep 8 01:03:51 2022] PUT /identity/v3/projects/454105f786874ed1b407da41aef24389/users/e7e636a8e4704971ae840035f3fc4e01/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:03:54.154457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444be9d-cfc3-4ec5-a80e-148de9dbbe92 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:54.155011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444be9d-cfc3-4ec5-a80e-148de9dbbe92 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:54.155011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444be9d-cfc3-4ec5-a80e-148de9dbbe92 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:54.156342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 640/1274] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:03:54.161624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bff721-3f36-4110-a315-39b7416ffc79 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:54.161988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bff721-3f36-4110-a315-39b7416ffc79 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:54.162185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bff721-3f36-4110-a315-39b7416ffc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:54.181395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-51bff721-3f36-4110-a315-39b7416ffc79 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:03:54.182745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-51bff721-3f36-4110-a315-39b7416ffc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:03:54.249879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 635/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:03:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:03:54.517881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444be9d-cfc3-4ec5-a80e-148de9dbbe92 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:54.616171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444be9d-cfc3-4ec5-a80e-148de9dbbe92 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:54.632573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:54.650452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903c53-b531-43f0-80cb-e96d242ca09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:54.651069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903c53-b531-43f0-80cb-e96d242ca09d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:54.651345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903c53-b531-43f0-80cb-e96d242ca09d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:54.651615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903c53-b531-43f0-80cb-e96d242ca09d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:54.661318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09903c53-b531-43f0-80cb-e96d242ca09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-09903c53-b531-43f0-80cb-e96d242ca09d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 01:03:54.666150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:54.667236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:54.668440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 641/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Sep 8 01:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:54.673122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bff721-3f36-4110-a315-39b7416ffc79 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:54.750619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:54.769291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bff721-3f36-4110-a315-39b7416ffc79 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:54.801905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95359947-55bd-41a4-93db-66908b809863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:54.802494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359947-55bd-41a4-93db-66908b809863 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:54.802773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359947-55bd-41a4-93db-66908b809863 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:54.803046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359947-55bd-41a4-93db-66908b809863 None admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:54.803705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359947-55bd-41a4-93db-66908b809863 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:54.804010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359947-55bd-41a4-93db-66908b809863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:54.805391 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359947-55bd-41a4-93db-66908b809863 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:54.813103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 636/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Sep 8 01:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:54.818725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903c53-b531-43f0-80cb-e96d242ca09d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:54.923373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903c53-b531-43f0-80cb-e96d242ca09d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:54.958090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:54.958708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:54.958985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:54.959255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:54.968882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:54.970341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:54.984406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:54.985484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:54.986392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:54.986392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:54.986392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:54.986392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 642/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:54.991260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95359947-55bd-41a4-93db-66908b809863 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:55.091056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95359947-55bd-41a4-93db-66908b809863 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:55.123342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:55.123938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:55.124219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:55.124494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:55.125134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:55.125467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:55.126831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:55.138806 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 637/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:55.144789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:55.175134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:55.245992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95de94c-e02b-420f-93c4-ebc1a0dfacfa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:55.278799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:55.279414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:55.279698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:55.279968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:55.287157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:55.288592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 01:03:55.300178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:55.301269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:55.302584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 643/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:55.307677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:55.311483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:55.404490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bb60f-20d9-4461-8f9d-5a65685540ac None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:55.437949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:55.438544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:55.438825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:55.439102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:55.439846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:55.440157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:55.441600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:55.458165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 638/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Sep 8 01:03:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:55.466013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:55.554587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:55.565100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3b8fe-0f08-4a5c-9e62-87847987a098 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:55.596957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68a21b-2edd-46b5-855d-baf6b6f5f433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:55.597586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a21b-2edd-46b5-855d-baf6b6f5f433 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:55.597867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a21b-2edd-46b5-855d-baf6b6f5f433 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:55.598140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a21b-2edd-46b5-855d-baf6b6f5f433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:55.663027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68a21b-2edd-46b5-855d-baf6b6f5f433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:55.664990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68a21b-2edd-46b5-855d-baf6b6f5f433 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:55.749465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:55.759908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 644/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Sep 8 01:03:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 01:03:55.765971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:55.824771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:55.862266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5593a91-5c71-4a22-a065-12197b83e137 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:55.899288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:55.899901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:55.900173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:55.900438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:55.910212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:55.911637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 01:03:55.926305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:55.927418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 01:03:55.928713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 01:03:55.928713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 01:03:55.928713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:55.928713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 639/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:55.933084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68a21b-2edd-46b5-855d-baf6b6f5f433 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:56.029144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68a21b-2edd-46b5-855d-baf6b6f5f433 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:56.060885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:56.061497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:56.061775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:56.062045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:56.062677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:56.062976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:56.064315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:56.075415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 645/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Sep 8 01:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:56.080779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:56.177634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17443bef-132b-432a-976a-33c9ce7f8b86 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:56.190515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:56.210505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:56.211710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:56.211989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:56.212264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:56.218729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:56.220147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 01:03:56.231165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:56.232185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: ERROR keystone.server.flask.application Sep 08 01:03:56.233449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 640/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Sep 8 01:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:56.237984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:56.286669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:56.334313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a2ac-99b1-4bc1-9516-48e7fc49ace5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:56.366353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ee60c-bb04-4f5d-8844-d0f475210cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:56.366940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee60c-bb04-4f5d-8844-d0f475210cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:56.367216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee60c-bb04-4f5d-8844-d0f475210cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:56.368010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ee60c-bb04-4f5d-8844-d0f475210cc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:56.368685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ee60c-bb04-4f5d-8844-d0f475210cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:56.368984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ee60c-bb04-4f5d-8844-d0f475210cc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:56.370416 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ee60c-bb04-4f5d-8844-d0f475210cc4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:56.381862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 646/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Sep 8 01:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:56.388437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:56.484018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5cda-aba2-46f1-8e19-b5508f91b0e4 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:56.517326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9345c-474b-4a0d-9277-b165740d248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:56.517954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9345c-474b-4a0d-9277-b165740d248e None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:56.518230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9345c-474b-4a0d-9277-b165740d248e None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:56.518500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9345c-474b-4a0d-9277-b165740d248e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:56.519216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9345c-474b-4a0d-9277-b165740d248e None admin] RBAC: Adding query filter params (role.id=c182619b007b495f912901d866e751e1, scope.project.id=454105f786874ed1b407da41aef24389, user.id=e7e636a8e4704971ae840035f3fc4e01) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:56.519520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9345c-474b-4a0d-9277-b165740d248e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:56.520927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9345c-474b-4a0d-9277-b165740d248e None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:56.527111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 641/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Sep 8 01:03:56 2022] GET /identity/v3/role_assignments?user.id=e7e636a8e4704971ae840035f3fc4e01&scope.project.id=454105f786874ed1b407da41aef24389&role.id=c182619b007b495f912901d866e751e1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:58.724974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fe20-6096-417c-ae5e-5337a65bfa20 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:58.725510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fe20-6096-417c-ae5e-5337a65bfa20 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:58.725604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fe20-6096-417c-ae5e-5337a65bfa20 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:58.727471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 647/1288] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:03:58.732761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746043b-0072-4e48-8ed2-898b780c1a53 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:58.733165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746043b-0072-4e48-8ed2-898b780c1a53 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:58.733746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746043b-0072-4e48-8ed2-898b780c1a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:58.756270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a746043b-0072-4e48-8ed2-898b780c1a53 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:03:58.757483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a746043b-0072-4e48-8ed2-898b780c1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:03:58.786276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:58.822348 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 642/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:03:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:03:59.112456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069fe20-6096-417c-ae5e-5337a65bfa20 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:59.210576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069fe20-6096-417c-ae5e-5337a65bfa20 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:59.221262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:03:59.244578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:59.245191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:59.245493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:59.245765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:59.246334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:59.247679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:03:59.256122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:03:59.257307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:03:59.258716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 648/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:03:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:03:59.263561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746043b-0072-4e48-8ed2-898b780c1a53 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:59.357854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746043b-0072-4e48-8ed2-898b780c1a53 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:59.391503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122237c4-f7a1-4b52-b67d-f2968abc224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:59.392504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122237c4-f7a1-4b52-b67d-f2968abc224a None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:59.392990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122237c4-f7a1-4b52-b67d-f2968abc224a None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:59.393490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122237c4-f7a1-4b52-b67d-f2968abc224a None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:59.394611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122237c4-f7a1-4b52-b67d-f2968abc224a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:59.395122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122237c4-f7a1-4b52-b67d-f2968abc224a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:59.397587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122237c4-f7a1-4b52-b67d-f2968abc224a None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:59.404523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 643/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Sep 8 01:03:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:03:59.410402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:03:59.505344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764b0b7-da8b-4e9d-b5f2-06b34b0a024d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:03:59.538758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824031f-b78b-4138-ac8a-488fe0e88aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:03:59.539350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824031f-b78b-4138-ac8a-488fe0e88aba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:03:59.539625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824031f-b78b-4138-ac8a-488fe0e88aba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:03:59.539891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824031f-b78b-4138-ac8a-488fe0e88aba None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:03:59.540504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824031f-b78b-4138-ac8a-488fe0e88aba None admin] RBAC: Adding query filter params (type=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:03:59.540800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824031f-b78b-4138-ac8a-488fe0e88aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:03:59.542190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824031f-b78b-4138-ac8a-488fe0e88aba None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:03:59.546478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 649/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Sep 8 01:03:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:04:01.643866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a02c-cf29-4b99-9496-6ad1b50c4d2f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:01.644383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a02c-cf29-4b99-9496-6ad1b50c4d2f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:01.644488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a02c-cf29-4b99-9496-6ad1b50c4d2f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:01.645783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 644/1293] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:04:01.650789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc720-e1cb-40d0-b606-cf08a33c823b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:01.651184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc720-e1cb-40d0-b606-cf08a33c823b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:01.651337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc720-e1cb-40d0-b606-cf08a33c823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:01.669027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d83dc720-e1cb-40d0-b606-cf08a33c823b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:04:01.670236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d83dc720-e1cb-40d0-b606-cf08a33c823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:04:01.699831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:04:01.735901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 650/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:04:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:04:02.003711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792a02c-cf29-4b99-9496-6ad1b50c4d2f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:04:02.034553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:04:02.103299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792a02c-cf29-4b99-9496-6ad1b50c4d2f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:04:02.136186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2104b-3aad-4c9a-8cdc-9e67b12ecfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:04:02.136769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2104b-3aad-4c9a-8cdc-9e67b12ecfed None admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:02.137045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2104b-3aad-4c9a-8cdc-9e67b12ecfed None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:02.137314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2104b-3aad-4c9a-8cdc-9e67b12ecfed None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:02.137982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2104b-3aad-4c9a-8cdc-9e67b12ecfed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:04:02.139315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2104b-3aad-4c9a-8cdc-9e67b12ecfed None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:04:02.153219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 645/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Sep 8 01:04:02 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:04:04.269951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd99f2-8723-4112-98bd-338a4c536fd8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:04.270515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd99f2-8723-4112-98bd-338a4c536fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:04.270515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd99f2-8723-4112-98bd-338a4c536fd8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:04.271841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 651/1296] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:04:04.276907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481d9b5-0e1d-443e-ab00-5f98eca981b1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:04.277274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481d9b5-0e1d-443e-ab00-5f98eca981b1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:04.277489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481d9b5-0e1d-443e-ab00-5f98eca981b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:04.295723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3481d9b5-0e1d-443e-ab00-5f98eca981b1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:04:04.296891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3481d9b5-0e1d-443e-ab00-5f98eca981b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:04:04.365859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 646/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:04:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:04:04.628618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd99f2-8723-4112-98bd-338a4c536fd8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:04:04.727580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd99f2-8723-4112-98bd-338a4c536fd8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:04:04.760918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:04:04.761561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:04.761842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:04.762113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:04.762687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:04:04.764043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:04:04.772869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:04:04.777569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:04:04.778635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 652/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:04:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:04:04.779813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481d9b5-0e1d-443e-ab00-5f98eca981b1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:04:04.797695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:04:04.880667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481d9b5-0e1d-443e-ab00-5f98eca981b1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:04:04.919143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:04:04.919824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:04.920095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:04.920299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:04.920936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:04:04.921238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:04:04.922717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:04:04.928608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 647/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Sep 8 01:04:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:04:04.935836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:04:04.968137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:04:05.034575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3cffc-7618-49d2-866a-d563f5537118 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:04:05.067100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1b2f3-d278-4e74-b34a-93e801eb7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:04:05.067688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1b2f3-d278-4e74-b34a-93e801eb7b45 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:05.067963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1b2f3-d278-4e74-b34a-93e801eb7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:05.068231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1b2f3-d278-4e74-b34a-93e801eb7b45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:05.068912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1b2f3-d278-4e74-b34a-93e801eb7b45 None admin] RBAC: Adding query filter params (interface=public, service_id=14b8d322c0f549fabbc009461f806fe2, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:04:05.069214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1b2f3-d278-4e74-b34a-93e801eb7b45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:04:05.070627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1b2f3-d278-4e74-b34a-93e801eb7b45 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:04:05.075395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 653/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Sep 8 01:04:04 2022] GET /identity/v3/endpoints?service_id=14b8d322c0f549fabbc009461f806fe2&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:04:05.081041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:04:05.160513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:04:05.178679 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a5603-d678-454c-8a56-884fe214a099 None admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:04:05.211451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cecfef-4906-4445-a4b3-f11503938046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:04:05.212044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cecfef-4906-4445-a4b3-f11503938046 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:05.212324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cecfef-4906-4445-a4b3-f11503938046 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:05.212595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cecfef-4906-4445-a4b3-f11503938046 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:05.213189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cecfef-4906-4445-a4b3-f11503938046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:04:05.214572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cecfef-4906-4445-a4b3-f11503938046 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:04:05.221111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 648/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Sep 8 01:04:05 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:04:07.322012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efbd3d-8edf-42ad-898b-67b62316be2e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:07.322569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efbd3d-8edf-42ad-898b-67b62316be2e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:07.322569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efbd3d-8edf-42ad-898b-67b62316be2e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:07.323903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 654/1302] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:04:07.329143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93da1-2db6-434f-9298-18323cdc8def None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:07.329561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93da1-2db6-434f-9298-18323cdc8def None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:07.329728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93da1-2db6-434f-9298-18323cdc8def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:07.347378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-41b93da1-2db6-434f-9298-18323cdc8def None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:04:07.348563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-41b93da1-2db6-434f-9298-18323cdc8def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:04:07.415622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 649/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:04:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 01:04:07.676984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efbd3d-8edf-42ad-898b-67b62316be2e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:04:07.770335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:04:07.777818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efbd3d-8edf-42ad-898b-67b62316be2e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:04:07.810384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:04:07.811000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:07.811278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:07.811549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:07.812122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:04:07.813508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 01:04:07.822130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 01:04:07.823278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Sep 08 01:04:07.824380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 655/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Sep 8 01:04:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 01:04:07.829167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b93da1-2db6-434f-9298-18323cdc8def None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:04:07.906481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:04:07.930327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b93da1-2db6-434f-9298-18323cdc8def None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:04:07.963180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab0b63-15c7-4ec1-9fb2-60f0a9438e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:04:07.963773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab0b63-15c7-4ec1-9fb2-60f0a9438e22 None admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:07.964050 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab0b63-15c7-4ec1-9fb2-60f0a9438e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:07.964317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab0b63-15c7-4ec1-9fb2-60f0a9438e22 None admin] PATH_INFO: `/v3/services` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:07.964937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab0b63-15c7-4ec1-9fb2-60f0a9438e22 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:04:07.965235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab0b63-15c7-4ec1-9fb2-60f0a9438e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:04:07.966623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab0b63-15c7-4ec1-9fb2-60f0a9438e22 None admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:04:07.971539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 650/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Sep 8 01:04:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:04:07.977947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:04:08.075121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44f404-adb6-4d3a-8d35-d6e91cceb5b0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:04:08.107706 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5349d7a-01ba-46b0-915f-e27c83c56819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:04:08.108297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349d7a-01ba-46b0-915f-e27c83c56819 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:04:08.108574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349d7a-01ba-46b0-915f-e27c83c56819 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:04:08.108845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349d7a-01ba-46b0-915f-e27c83c56819 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:04:08.109530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5349d7a-01ba-46b0-915f-e27c83c56819 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:04:08.110884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5349d7a-01ba-46b0-915f-e27c83c56819 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:04:08.129456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 656/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:04:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:04:17.968669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=30 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:04:18.125269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:11.623284 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6f731-d43a-4adb-a114-4244380addbe None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:11.625341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6f731-d43a-4adb-a114-4244380addbe None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:11.625779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6f731-d43a-4adb-a114-4244380addbe None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:11.631191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 651/1307] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:11.632819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2636ac-cbb1-4e31-bf9d-190cb6dac084 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:11.633225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2636ac-cbb1-4e31-bf9d-190cb6dac084 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:11.633512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2636ac-cbb1-4e31-bf9d-190cb6dac084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:11.788729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7b2636ac-cbb1-4e31-bf9d-190cb6dac084 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:11.790012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7b2636ac-cbb1-4e31-bf9d-190cb6dac084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:11.957681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 657/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:12.254826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf96d7-85e8-4d7a-b15c-516884a956b4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:12.255201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf96d7-85e8-4d7a-b15c-516884a956b4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:12.255380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf96d7-85e8-4d7a-b15c-516884a956b4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:12.257133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 652/1309] 10.222.0.20 () {54 vars in 965 bytes} [Thu Sep 8 01:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:12.263392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de315b0-cde2-4414-b439-0c43f23d2b7c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:12.264194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de315b0-cde2-4414-b439-0c43f23d2b7c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:12.264705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de315b0-cde2-4414-b439-0c43f23d2b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:12.358899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5de315b0-cde2-4414-b439-0c43f23d2b7c None None] MFA Rules not processed for user `5a6ff1b9371a411bae7b3e45f78e05e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:12.360121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5de315b0-cde2-4414-b439-0c43f23d2b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:12.384721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:12.447486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 658/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Sep 8 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:12.456767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf96d7-85e8-4d7a-b15c-516884a956b4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:12.459599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1bdf96d7-85e8-4d7a-b15c-516884a956b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:12.591784 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf96d7-85e8-4d7a-b15c-516884a956b4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:12.678648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f05359-548d-476f-859f-7356cdd534d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:12.679313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f05359-548d-476f-859f-7356cdd534d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:12.679595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f05359-548d-476f-859f-7356cdd534d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:12.679891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f05359-548d-476f-859f-7356cdd534d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:12.681680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b8f05359-548d-476f-859f-7356cdd534d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:12.742300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:12.810360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f05359-548d-476f-859f-7356cdd534d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:12.811729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f05359-548d-476f-859f-7356cdd534d4 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:12.832760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 653/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:15.322782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313c4a-0bb0-44db-a061-6eb92a0d5a0d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:15.323267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313c4a-0bb0-44db-a061-6eb92a0d5a0d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:15.323381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313c4a-0bb0-44db-a061-6eb92a0d5a0d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:15.324661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 659/1312] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:15.329990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd16c6-ee26-4014-ac7a-fa42e50d3049 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:15.330424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd16c6-ee26-4014-ac7a-fa42e50d3049 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:15.330543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd16c6-ee26-4014-ac7a-fa42e50d3049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:15.410960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-67fd16c6-ee26-4014-ac7a-fa42e50d3049 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:15.412199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-67fd16c6-ee26-4014-ac7a-fa42e50d3049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:15.509534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 654/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:15.791679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd313c4a-0bb0-44db-a061-6eb92a0d5a0d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:15.793250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bd313c4a-0bb0-44db-a061-6eb92a0d5a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:15.895885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd313c4a-0bb0-44db-a061-6eb92a0d5a0d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:15.964179 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:15.966602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da007c30-ce48-466d-9d8b-14047c7ccb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:15.967216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da007c30-ce48-466d-9d8b-14047c7ccb49 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:15.967685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da007c30-ce48-466d-9d8b-14047c7ccb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:15.968185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da007c30-ce48-466d-9d8b-14047c7ccb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:15.970010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-da007c30-ce48-466d-9d8b-14047c7ccb49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:16.081840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da007c30-ce48-466d-9d8b-14047c7ccb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:16.083197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da007c30-ce48-466d-9d8b-14047c7ccb49 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:16.100814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 660/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:18.536360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38c9f6-40aa-4c2e-8e46-0e8fcbb6cbad None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:18.536914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38c9f6-40aa-4c2e-8e46-0e8fcbb6cbad None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:18.537019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38c9f6-40aa-4c2e-8e46-0e8fcbb6cbad None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:18.538468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 655/1315] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:18.543500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be388-8445-40f2-84b5-9f1bc1bc6368 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:18.543941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be388-8445-40f2-84b5-9f1bc1bc6368 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:18.544053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be388-8445-40f2-84b5-9f1bc1bc6368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:18.611377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6d4be388-8445-40f2-84b5-9f1bc1bc6368 None None] MFA Rules not processed for user `1526aa7734774ccf820a8c5a4d4f9a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:18.612572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6d4be388-8445-40f2-84b5-9f1bc1bc6368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:18.666661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:18.713029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 661/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:19.004853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38c9f6-40aa-4c2e-8e46-0e8fcbb6cbad None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:19.007054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-da38c9f6-40aa-4c2e-8e46-0e8fcbb6cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:19.017080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:19.109424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38c9f6-40aa-4c2e-8e46-0e8fcbb6cbad None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:19.184983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba994a2-b371-459f-8c74-3651198aa23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:19.185611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba994a2-b371-459f-8c74-3651198aa23d service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:19.185889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba994a2-b371-459f-8c74-3651198aa23d service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:19.186159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba994a2-b371-459f-8c74-3651198aa23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:19.187789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4ba994a2-b371-459f-8c74-3651198aa23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:19.250332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:19.298107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba994a2-b371-459f-8c74-3651198aa23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:19.299560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba994a2-b371-459f-8c74-3651198aa23d service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:19.318645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 656/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:21.990381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a2210-af04-4517-aa06-bae23c8afae1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:21.990947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a2210-af04-4517-aa06-bae23c8afae1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:21.990947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a2210-af04-4517-aa06-bae23c8afae1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:21.992298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 662/1318] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:21.997495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca66cb2-2ff5-43bf-932f-949db79067c7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:21.997885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca66cb2-2ff5-43bf-932f-949db79067c7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:21.998046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca66cb2-2ff5-43bf-932f-949db79067c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:22.063188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fca66cb2-2ff5-43bf-932f-949db79067c7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:22.064401 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fca66cb2-2ff5-43bf-932f-949db79067c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:22.164500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 657/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:22.452335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a2210-af04-4517-aa06-bae23c8afae1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:22.453904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-047a2210-af04-4517-aa06-bae23c8afae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:22.557130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a2210-af04-4517-aa06-bae23c8afae1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:22.628369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c08c8d-5703-4dd6-8b7c-6a4e167b74df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:22.628961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08c8d-5703-4dd6-8b7c-6a4e167b74df service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:22.629243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08c8d-5703-4dd6-8b7c-6a4e167b74df service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:22.629542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08c8d-5703-4dd6-8b7c-6a4e167b74df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:22.631132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-02c08c8d-5703-4dd6-8b7c-6a4e167b74df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:22.637839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:22.738249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c08c8d-5703-4dd6-8b7c-6a4e167b74df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:22.739608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c08c8d-5703-4dd6-8b7c-6a4e167b74df service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:22.756964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 663/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:25.551411 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369888-c865-437a-8038-35b8d6437c21 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:25.551961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369888-c865-437a-8038-35b8d6437c21 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:25.551961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369888-c865-437a-8038-35b8d6437c21 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:25.553279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 658/1321] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:25.558571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f1a2e-782b-4aac-a069-40baed32bb5a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:25.558975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f1a2e-782b-4aac-a069-40baed32bb5a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:25.559115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f1a2e-782b-4aac-a069-40baed32bb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:25.632848 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-751f1a2e-782b-4aac-a069-40baed32bb5a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:25.634115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-751f1a2e-782b-4aac-a069-40baed32bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:25.695960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:25.738399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 664/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:26.022338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369888-c865-437a-8038-35b8d6437c21 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:26.023871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7a369888-c865-437a-8038-35b8d6437c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:26.044162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:26.126751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369888-c865-437a-8038-35b8d6437c21 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:26.212901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a309381-7108-4e6e-95f3-7fae4aefd358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:26.213537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309381-7108-4e6e-95f3-7fae4aefd358 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:26.213814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309381-7108-4e6e-95f3-7fae4aefd358 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:26.214079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309381-7108-4e6e-95f3-7fae4aefd358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:26.215647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3a309381-7108-4e6e-95f3-7fae4aefd358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:26.286065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:26.325257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a309381-7108-4e6e-95f3-7fae4aefd358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:26.326718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a309381-7108-4e6e-95f3-7fae4aefd358 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:26.345846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 659/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:28.578326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8c5f1-6083-46ff-92ee-3b573518aa77 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:28.578876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8c5f1-6083-46ff-92ee-3b573518aa77 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:28.578876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8c5f1-6083-46ff-92ee-3b573518aa77 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:28.580401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 665/1324] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:28.586112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c15cd-242d-4d45-96e9-6466c6ce347f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:28.586559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c15cd-242d-4d45-96e9-6466c6ce347f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:28.586733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c15cd-242d-4d45-96e9-6466c6ce347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:28.660294 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-957c15cd-242d-4d45-96e9-6466c6ce347f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:28.661948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-957c15cd-242d-4d45-96e9-6466c6ce347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:28.759485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 660/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:29.042255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8c5f1-6083-46ff-92ee-3b573518aa77 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:29.043862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ddf8c5f1-6083-46ff-92ee-3b573518aa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:29.147660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8c5f1-6083-46ff-92ee-3b573518aa77 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:29.229648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3401710-5ae0-4bbd-b959-ab1303b5de35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:29.230431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401710-5ae0-4bbd-b959-ab1303b5de35 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:29.230763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401710-5ae0-4bbd-b959-ab1303b5de35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:29.231038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401710-5ae0-4bbd-b959-ab1303b5de35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:29.232776 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f3401710-5ae0-4bbd-b959-ab1303b5de35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:29.251748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:29.352711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3401710-5ae0-4bbd-b959-ab1303b5de35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:29.354096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3401710-5ae0-4bbd-b959-ab1303b5de35 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:29.372449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 666/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:31.576245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8249-1ee5-4f0b-a442-265c4cac8404 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:31.577046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8249-1ee5-4f0b-a442-265c4cac8404 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:31.577344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8249-1ee5-4f0b-a442-265c4cac8404 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:31.578895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 661/1327] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:31.585162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eda4b4-f34f-484f-bff4-cd09a8bf4042 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:31.585613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eda4b4-f34f-484f-bff4-cd09a8bf4042 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:31.585807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eda4b4-f34f-484f-bff4-cd09a8bf4042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:31.657907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-95eda4b4-f34f-484f-bff4-cd09a8bf4042 None None] MFA Rules not processed for user `1526aa7734774ccf820a8c5a4d4f9a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:31.659108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-95eda4b4-f34f-484f-bff4-cd09a8bf4042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:31.722976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:31.754943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 667/1328] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:32.043094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc8249-1ee5-4f0b-a442-265c4cac8404 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:32.044303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7dbc8249-1ee5-4f0b-a442-265c4cac8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:32.076242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:32.150761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc8249-1ee5-4f0b-a442-265c4cac8404 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:32.223640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54d9e3-4caa-40ea-a324-d1981f0a2b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:32.224772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d9e3-4caa-40ea-a324-d1981f0a2b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:32.225057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d9e3-4caa-40ea-a324-d1981f0a2b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:32.225331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d9e3-4caa-40ea-a324-d1981f0a2b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:32.226964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4c54d9e3-4caa-40ea-a324-d1981f0a2b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:32.304008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:32.338513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54d9e3-4caa-40ea-a324-d1981f0a2b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:32.339878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54d9e3-4caa-40ea-a324-d1981f0a2b3d service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:32.358934 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 662/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:34.717566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62e36e-f57f-4b41-86a1-3fc14129a7bf None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:34.718087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62e36e-f57f-4b41-86a1-3fc14129a7bf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:34.718200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62e36e-f57f-4b41-86a1-3fc14129a7bf None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:34.719460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 668/1330] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:34.725233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b084-7f6f-45fd-9b91-4d3bcc30312a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:34.725666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b084-7f6f-45fd-9b91-4d3bcc30312a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:34.725820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b084-7f6f-45fd-9b91-4d3bcc30312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:34.790846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-fdc1b084-7f6f-45fd-9b91-4d3bcc30312a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:34.791975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-fdc1b084-7f6f-45fd-9b91-4d3bcc30312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:34.886253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 663/1331] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:35.166192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62e36e-f57f-4b41-86a1-3fc14129a7bf None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:35.167729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6b62e36e-f57f-4b41-86a1-3fc14129a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:35.268749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62e36e-f57f-4b41-86a1-3fc14129a7bf None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:35.342420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af989a3-e468-4763-bb82-25b9333cf8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:35.343023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af989a3-e468-4763-bb82-25b9333cf8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:35.343304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af989a3-e468-4763-bb82-25b9333cf8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:35.343574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af989a3-e468-4763-bb82-25b9333cf8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:35.345150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0af989a3-e468-4763-bb82-25b9333cf8e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:35.372165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:35.452829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af989a3-e468-4763-bb82-25b9333cf8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:35.454214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af989a3-e468-4763-bb82-25b9333cf8e2 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:35.471905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 669/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:37.637662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e72a0-368c-4786-9795-232bcd7a2147 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:37.638211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e72a0-368c-4786-9795-232bcd7a2147 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:37.638211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e72a0-368c-4786-9795-232bcd7a2147 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:37.639579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 664/1333] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:37.645167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384ea5-b52a-43b6-928e-a563ae800c3a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:37.645641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384ea5-b52a-43b6-928e-a563ae800c3a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:37.645787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384ea5-b52a-43b6-928e-a563ae800c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:37.710052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-87384ea5-b52a-43b6-928e-a563ae800c3a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:37.711246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-87384ea5-b52a-43b6-928e-a563ae800c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:37.784165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:37.806532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 670/1334] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:38.088120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e72a0-368c-4786-9795-232bcd7a2147 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:38.089695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1d9e72a0-368c-4786-9795-232bcd7a2147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:38.129154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:38.191707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e72a0-368c-4786-9795-232bcd7a2147 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:38.264343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956841ee-5643-41b5-838b-cf2db36a29d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:38.264942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956841ee-5643-41b5-838b-cf2db36a29d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:38.265223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956841ee-5643-41b5-838b-cf2db36a29d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:38.265777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956841ee-5643-41b5-838b-cf2db36a29d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:38.267354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-956841ee-5643-41b5-838b-cf2db36a29d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:38.353528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:38.379591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956841ee-5643-41b5-838b-cf2db36a29d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:38.381102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956841ee-5643-41b5-838b-cf2db36a29d6 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:38.399233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 665/1335] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:40.884015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf8eab-8da8-4a04-a523-5ae61bb57535 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:40.884560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf8eab-8da8-4a04-a523-5ae61bb57535 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:40.884560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf8eab-8da8-4a04-a523-5ae61bb57535 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:40.885948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 671/1336] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:40.891295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f207d2-d5ca-45f1-af58-a65bbd7a7e31 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:40.891720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f207d2-d5ca-45f1-af58-a65bbd7a7e31 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:40.891896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f207d2-d5ca-45f1-af58-a65bbd7a7e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:40.955952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-92f207d2-d5ca-45f1-af58-a65bbd7a7e31 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:40.957152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-92f207d2-d5ca-45f1-af58-a65bbd7a7e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:41.051831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 666/1337] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:41.327984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf8eab-8da8-4a04-a523-5ae61bb57535 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:41.329588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-25cf8eab-8da8-4a04-a523-5ae61bb57535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:41.431345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf8eab-8da8-4a04-a523-5ae61bb57535 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:41.504560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05c76b-7c62-45de-956e-9ec383be90c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:41.505672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c76b-7c62-45de-956e-9ec383be90c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:41.505951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c76b-7c62-45de-956e-9ec383be90c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:41.506218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c76b-7c62-45de-956e-9ec383be90c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:41.507808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-af05c76b-7c62-45de-956e-9ec383be90c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:41.553990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:41.626700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05c76b-7c62-45de-956e-9ec383be90c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:41.628128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05c76b-7c62-45de-956e-9ec383be90c2 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:41.646825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 672/1338] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:45.643528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfec35-ca3f-4fb4-bccf-7a25314210e7 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:45.644117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfec35-ca3f-4fb4-bccf-7a25314210e7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:45.644117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfec35-ca3f-4fb4-bccf-7a25314210e7 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:45.645577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 667/1339] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:45.650865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7887cc-22e5-404c-a506-b3b8c84fdf7f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:45.651302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7887cc-22e5-404c-a506-b3b8c84fdf7f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:45.651441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7887cc-22e5-404c-a506-b3b8c84fdf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:45.716894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4a7887cc-22e5-404c-a506-b3b8c84fdf7f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:45.718037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4a7887cc-22e5-404c-a506-b3b8c84fdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:45.804653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:45.816490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 673/1340] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:46.113576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff4eb8-71de-4495-bf03-f5741d9f6f72 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:46.113867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff4eb8-71de-4495-bf03-f5741d9f6f72 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:46.114152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff4eb8-71de-4495-bf03-f5741d9f6f72 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:46.115494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 668/1341] 10.222.0.20 () {54 vars in 965 bytes} [Thu Sep 8 01:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:46.121366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb56a5-0b23-43cf-8f61-50e927494e1a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:46.121675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb56a5-0b23-43cf-8f61-50e927494e1a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:46.121966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb56a5-0b23-43cf-8f61-50e927494e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:46.199134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-55eb56a5-0b23-43cf-8f61-50e927494e1a None None] MFA Rules not processed for user `5a6ff1b9371a411bae7b3e45f78e05e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:46.200344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-55eb56a5-0b23-43cf-8f61-50e927494e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:46.277094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 674/1342] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Sep 8 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:46.288131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff4eb8-71de-4495-bf03-f5741d9f6f72 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:46.289918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dcff4eb8-71de-4495-bf03-f5741d9f6f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:46.338875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:46.393475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff4eb8-71de-4495-bf03-f5741d9f6f72 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:46.466157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a475bc-bd3a-4390-914f-13f143ae0e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:46.466759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a475bc-bd3a-4390-914f-13f143ae0e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:46.467037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a475bc-bd3a-4390-914f-13f143ae0e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:46.467308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a475bc-bd3a-4390-914f-13f143ae0e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:46.468875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c2a475bc-bd3a-4390-914f-13f143ae0e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:46.585628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:46.605040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a475bc-bd3a-4390-914f-13f143ae0e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:46.606556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a475bc-bd3a-4390-914f-13f143ae0e6b service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:46.626921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 669/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:05:49.957233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f45e-0406-46b6-b0fd-77107dc91226 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:49.958413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f45e-0406-46b6-b0fd-77107dc91226 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:49.958413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f45e-0406-46b6-b0fd-77107dc91226 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:49.959687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 675/1344] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:49.964847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd9511-890f-4fe7-a6c5-d80bb78a6c59 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:49.965236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd9511-890f-4fe7-a6c5-d80bb78a6c59 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:49.965432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd9511-890f-4fe7-a6c5-d80bb78a6c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:50.033179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-70dd9511-890f-4fe7-a6c5-d80bb78a6c59 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:50.034439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-70dd9511-890f-4fe7-a6c5-d80bb78a6c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:50.131691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 670/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:50.412480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8f45e-0406-46b6-b0fd-77107dc91226 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:50.414067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-27f8f45e-0406-46b6-b0fd-77107dc91226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:50.509486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:50.526750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8f45e-0406-46b6-b0fd-77107dc91226 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:50.599368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3f347-1249-422d-a346-13d42c1bc8a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:50.599970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3f347-1249-422d-a346-13d42c1bc8a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:50.600246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3f347-1249-422d-a346-13d42c1bc8a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:50.600512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3f347-1249-422d-a346-13d42c1bc8a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:50.602132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-adb3f347-1249-422d-a346-13d42c1bc8a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:50.711169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3f347-1249-422d-a346-13d42c1bc8a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:50.712657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3f347-1249-422d-a346-13d42c1bc8a4 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:50.730675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 676/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:05:55.087455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853ebc7-b07e-43f5-90c7-cd64c6100f3f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:55.087943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853ebc7-b07e-43f5-90c7-cd64c6100f3f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:55.088036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853ebc7-b07e-43f5-90c7-cd64c6100f3f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:55.089327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 671/1347] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:05:55.094536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ab2c-7d46-4a1e-9a52-78a6e497dcdc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:55.094966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ab2c-7d46-4a1e-9a52-78a6e497dcdc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:55.095133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37ab2c-7d46-4a1e-9a52-78a6e497dcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:55.111688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:55.168057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-eb37ab2c-7d46-4a1e-9a52-78a6e497dcdc None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:05:55.169259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eb37ab2c-7d46-4a1e-9a52-78a6e497dcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:55.284327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 677/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:05:55.575614 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853ebc7-b07e-43f5-90c7-cd64c6100f3f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:05:55.577196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7853ebc7-b07e-43f5-90c7-cd64c6100f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:55.636061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:55.681702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853ebc7-b07e-43f5-90c7-cd64c6100f3f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:05:55.755184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c2662-4e17-41c7-ab4e-1453fc1b4e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:05:55.755786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2662-4e17-41c7-ab4e-1453fc1b4e31 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:05:55.756066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2662-4e17-41c7-ab4e-1453fc1b4e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:05:55.756341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2662-4e17-41c7-ab4e-1453fc1b4e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:05:55.757962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6c2c2662-4e17-41c7-ab4e-1453fc1b4e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:05:55.861747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:05:55.867057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c2662-4e17-41c7-ab4e-1453fc1b4e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:05:55.869468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c2662-4e17-41c7-ab4e-1453fc1b4e31 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:05:55.894992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 672/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:00.727518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf44d5-75b3-4915-a2e1-41576ef218f6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:00.727995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf44d5-75b3-4915-a2e1-41576ef218f6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:00.728079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf44d5-75b3-4915-a2e1-41576ef218f6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:00.729716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 678/1350] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:00.735076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8ecc2-5c1d-4e2c-9314-a2423210e558 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:00.735890 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8ecc2-5c1d-4e2c-9314-a2423210e558 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:00.736396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8ecc2-5c1d-4e2c-9314-a2423210e558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:00.850941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-63b8ecc2-5c1d-4e2c-9314-a2423210e558 None None] MFA Rules not processed for user `e7e636a8e4704971ae840035f3fc4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:00.852363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-63b8ecc2-5c1d-4e2c-9314-a2423210e558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:01.158576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 673/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:05.282662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=59 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:05.298622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ca1b5-a910-4f47-8f02-88a32c91285d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:05.298972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ca1b5-a910-4f47-8f02-88a32c91285d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:05.299197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ca1b5-a910-4f47-8f02-88a32c91285d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:05.300687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 679/1352] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:05.305481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df48-8830-4bbc-9aab-7b44c3bbe414 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:05.305913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df48-8830-4bbc-9aab-7b44c3bbe414 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:05.306159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df48-8830-4bbc-9aab-7b44c3bbe414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:05.361910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:05.390355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-46a9df48-8830-4bbc-9aab-7b44c3bbe414 None None] MFA Rules not processed for user `e7e636a8e4704971ae840035f3fc4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:05.391811 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-46a9df48-8830-4bbc-9aab-7b44c3bbe414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:05.522337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 674/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:06.771065 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb0d7-f093-4311-a11f-44012cba8972 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:06.771558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb0d7-f093-4311-a11f-44012cba8972 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:06.771558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb0d7-f093-4311-a11f-44012cba8972 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:06.772865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 680/1354] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:06.777736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb623ce-689f-4274-b1ff-8d393a235f68 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:06.778145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb623ce-689f-4274-b1ff-8d393a235f68 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:06.778429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb623ce-689f-4274-b1ff-8d393a235f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:06.856979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1eb623ce-689f-4274-b1ff-8d393a235f68 None None] MFA Rules not processed for user `e7e636a8e4704971ae840035f3fc4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:06.858231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1eb623ce-689f-4274-b1ff-8d393a235f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:06.904637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:06.973642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 675/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:06:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:10.469666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65bb29-e0cd-4aae-a4fc-1377c1033ffa None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:10.470217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65bb29-e0cd-4aae-a4fc-1377c1033ffa None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:10.470217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65bb29-e0cd-4aae-a4fc-1377c1033ffa None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:10.472515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 681/1356] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:10.477433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596659d0-8666-422c-984d-c19d4722c226 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:10.477433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596659d0-8666-422c-984d-c19d4722c226 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:10.477885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596659d0-8666-422c-984d-c19d4722c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:10.560482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-596659d0-8666-422c-984d-c19d4722c226 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:10.561906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-596659d0-8666-422c-984d-c19d4722c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:10.670686 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 676/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:10.972436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5325e8-29af-4dd1-ad8f-154691a7e652 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:10.972760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5325e8-29af-4dd1-ad8f-154691a7e652 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:10.973044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5325e8-29af-4dd1-ad8f-154691a7e652 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:10.974643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 682/1358] 10.222.0.20 () {54 vars in 962 bytes} [Thu Sep 8 01:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:10.982301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6382-65b4-48cb-b322-8d132847264a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:10.982818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6382-65b4-48cb-b322-8d132847264a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:10.983806 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6382-65b4-48cb-b322-8d132847264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:11.010944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:11.085317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0f9c6382-65b4-48cb-b322-8d132847264a None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:11.086947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f9c6382-65b4-48cb-b322-8d132847264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:11.223515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 677/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Sep 8 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:11.232296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5325e8-29af-4dd1-ad8f-154691a7e652 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:11.233943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5e5325e8-29af-4dd1-ad8f-154691a7e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:11.390069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5325e8-29af-4dd1-ad8f-154691a7e652 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:11.485721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:11.538608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b42f9-d1a5-487c-bf86-2e4517cbb3cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:11.539357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b42f9-d1a5-487c-bf86-2e4517cbb3cb service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:11.539716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b42f9-d1a5-487c-bf86-2e4517cbb3cb service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:11.540167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b42f9-d1a5-487c-bf86-2e4517cbb3cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:11.542160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-225b42f9-d1a5-487c-bf86-2e4517cbb3cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:11.642686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b42f9-d1a5-487c-bf86-2e4517cbb3cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:11.644386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b42f9-d1a5-487c-bf86-2e4517cbb3cb service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:11.666648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 683/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:14.072805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5919a-a723-42af-851a-1006cd066954 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:14.074201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5919a-a723-42af-851a-1006cd066954 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:14.074201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5919a-a723-42af-851a-1006cd066954 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:14.078621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 678/1361] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:14.080004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6efc-1ff0-42e5-9082-ce1ecdf2f38a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:14.080551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6efc-1ff0-42e5-9082-ce1ecdf2f38a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:14.080551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6efc-1ff0-42e5-9082-ce1ecdf2f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:14.153150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-88de6efc-1ff0-42e5-9082-ce1ecdf2f38a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:14.154529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-88de6efc-1ff0-42e5-9082-ce1ecdf2f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:14.196012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:14.260693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 684/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:06:14.557494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5919a-a723-42af-851a-1006cd066954 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:14.559218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3de5919a-a723-42af-851a-1006cd066954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:14.632030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:14.746456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5919a-a723-42af-851a-1006cd066954 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:14.891769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb330e1-cef1-4fa7-ba38-2ebce9aea2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:14.892298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb330e1-cef1-4fa7-ba38-2ebce9aea2a7 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:14.892575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb330e1-cef1-4fa7-ba38-2ebce9aea2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:14.892843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb330e1-cef1-4fa7-ba38-2ebce9aea2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:14.895179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-acb330e1-cef1-4fa7-ba38-2ebce9aea2a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:14.918421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:14.991389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb330e1-cef1-4fa7-ba38-2ebce9aea2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:14.991984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb330e1-cef1-4fa7-ba38-2ebce9aea2a7 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:15.010898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 679/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:17.471959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08a14-e345-4c59-9e11-38e65c2edc39 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:17.472563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08a14-e345-4c59-9e11-38e65c2edc39 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:17.472765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08a14-e345-4c59-9e11-38e65c2edc39 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:17.474255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 685/1364] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:17.479688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595212e-b6df-4b40-a90f-baa31249c1a7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:17.480106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595212e-b6df-4b40-a90f-baa31249c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:17.480283 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595212e-b6df-4b40-a90f-baa31249c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:17.554308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b595212e-b6df-4b40-a90f-baa31249c1a7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:17.555601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b595212e-b6df-4b40-a90f-baa31249c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:17.657199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:17.667489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 680/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:17.946365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1268b-a916-4af7-abb5-3d75190738ba None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:17.946837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1268b-a916-4af7-abb5-3d75190738ba None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:17.947206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1268b-a916-4af7-abb5-3d75190738ba None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:17.948693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 686/1366] 10.222.0.20 () {54 vars in 962 bytes} [Thu Sep 8 01:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:17.954192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3279a-deba-4bc5-968b-65d6a76d7bac None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:17.954577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3279a-deba-4bc5-968b-65d6a76d7bac None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:17.954945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3279a-deba-4bc5-968b-65d6a76d7bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:18.033701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-efc3279a-deba-4bc5-968b-65d6a76d7bac None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:18.035645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-efc3279a-deba-4bc5-968b-65d6a76d7bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:18.157480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 681/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Sep 8 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:18.165675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1268b-a916-4af7-abb5-3d75190738ba None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:18.167323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4ce1268b-a916-4af7-abb5-3d75190738ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:18.333382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1268b-a916-4af7-abb5-3d75190738ba None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:18.355812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:18.456572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a94d0a-a6d4-46a0-98c0-85c3d5046675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:18.457739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94d0a-a6d4-46a0-98c0-85c3d5046675 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:18.458022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94d0a-a6d4-46a0-98c0-85c3d5046675 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:18.458294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94d0a-a6d4-46a0-98c0-85c3d5046675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:18.459919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-07a94d0a-a6d4-46a0-98c0-85c3d5046675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:18.563997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a94d0a-a6d4-46a0-98c0-85c3d5046675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:18.565664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a94d0a-a6d4-46a0-98c0-85c3d5046675 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:18.586611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 687/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:06:18.663645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41626d-683d-4db7-9268-439f5ac9ec1c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:18.664233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41626d-683d-4db7-9268-439f5ac9ec1c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:18.664233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41626d-683d-4db7-9268-439f5ac9ec1c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:18.669832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 682/1369] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:06:18.672001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82631c7b-36c8-4d65-a5df-c6e03d554fa7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:18.672283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82631c7b-36c8-4d65-a5df-c6e03d554fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:18.672585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82631c7b-36c8-4d65-a5df-c6e03d554fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:18.712637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:18.756023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-82631c7b-36c8-4d65-a5df-c6e03d554fa7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:18.757260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-82631c7b-36c8-4d65-a5df-c6e03d554fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:18.907135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 688/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:19.225564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2300c90-a342-4280-9da3-11d667c8ac36 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:19.226180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2300c90-a342-4280-9da3-11d667c8ac36 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:19.226679 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2300c90-a342-4280-9da3-11d667c8ac36 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:19.228813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 683/1371] 10.222.0.20 () {54 vars in 964 bytes} [Thu Sep 8 01:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:19.234374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164e79c-9650-4661-84ce-05ca1c6eec3f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:19.234731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164e79c-9650-4661-84ce-05ca1c6eec3f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:19.235073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164e79c-9650-4661-84ce-05ca1c6eec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:19.318580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5164e79c-9650-4661-84ce-05ca1c6eec3f None None] MFA Rules not processed for user `274ba5fef7d24d97ac97c33a68bb6aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:19.319900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5164e79c-9650-4661-84ce-05ca1c6eec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:19.369911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:19.405496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 689/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Sep 8 01:06:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:19.413196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2300c90-a342-4280-9da3-11d667c8ac36 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:19.414736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b2300c90-a342-4280-9da3-11d667c8ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:19.470124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:19.532633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2300c90-a342-4280-9da3-11d667c8ac36 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:19.615212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999884f-93bc-4685-b6b8-7346ec17e88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:19.615802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999884f-93bc-4685-b6b8-7346ec17e88e service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:19.616087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999884f-93bc-4685-b6b8-7346ec17e88e service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:19.616358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999884f-93bc-4685-b6b8-7346ec17e88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:19.618156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f999884f-93bc-4685-b6b8-7346ec17e88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:19.735353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:19.756040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999884f-93bc-4685-b6b8-7346ec17e88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:19.757517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999884f-93bc-4685-b6b8-7346ec17e88e service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:19.778509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 684/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:20.899168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9d9d-90b7-4ca0-9c90-924b7bf84dc8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:20.899685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9d9d-90b7-4ca0-9c90-924b7bf84dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:20.899805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9d9d-90b7-4ca0-9c90-924b7bf84dc8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:20.901072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 690/1374] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:20.906220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3612099-3cab-4578-8acf-a1b5f427e9fd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:20.906644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3612099-3cab-4578-8acf-a1b5f427e9fd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:20.906766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3612099-3cab-4578-8acf-a1b5f427e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:20.973860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f3612099-3cab-4578-8acf-a1b5f427e9fd None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:20.975069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f3612099-3cab-4578-8acf-a1b5f427e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:21.074589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 685/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:21.367128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a9d9d-90b7-4ca0-9c90-924b7bf84dc8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:21.368788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-245a9d9d-90b7-4ca0-9c90-924b7bf84dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:21.526732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a9d9d-90b7-4ca0-9c90-924b7bf84dc8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:21.579684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:21.643444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7e13e-b3fc-48cc-b29b-46eb63efe520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:21.644064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e13e-b3fc-48cc-b29b-46eb63efe520 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:21.644342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e13e-b3fc-48cc-b29b-46eb63efe520 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:21.644615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7e13e-b3fc-48cc-b29b-46eb63efe520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:21.646290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-82c7e13e-b3fc-48cc-b29b-46eb63efe520 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:21.740285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7e13e-b3fc-48cc-b29b-46eb63efe520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:21.741928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7e13e-b3fc-48cc-b29b-46eb63efe520 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:21.761595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 691/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:23.979802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d92175-bf70-40f4-94d9-31ab405aa91f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:23.980353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d92175-bf70-40f4-94d9-31ab405aa91f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:23.980353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d92175-bf70-40f4-94d9-31ab405aa91f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:23.981879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 686/1377] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:23.986987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef5ce-53e4-4305-a89b-57eea96d8000 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:23.987401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef5ce-53e4-4305-a89b-57eea96d8000 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:23.987591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef5ce-53e4-4305-a89b-57eea96d8000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:24.055261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3fcef5ce-53e4-4305-a89b-57eea96d8000 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:24.056466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3fcef5ce-53e4-4305-a89b-57eea96d8000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:24.063852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:24.166617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 692/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:06:24.458728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d92175-bf70-40f4-94d9-31ab405aa91f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:24.460246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-43d92175-bf70-40f4-94d9-31ab405aa91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:24.530491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:24.620822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d92175-bf70-40f4-94d9-31ab405aa91f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:24.745924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249d990-d1b8-4d97-9c5e-48d546572b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:24.746452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249d990-d1b8-4d97-9c5e-48d546572b4a service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:24.746733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249d990-d1b8-4d97-9c5e-48d546572b4a service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:24.747008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249d990-d1b8-4d97-9c5e-48d546572b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:24.748627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d249d990-d1b8-4d97-9c5e-48d546572b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:24.769529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:24.848916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249d990-d1b8-4d97-9c5e-48d546572b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:24.850621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249d990-d1b8-4d97-9c5e-48d546572b4a service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:24.871739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 687/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:27.137582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0fc8b-8115-42b0-b697-bc06da186cc7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:27.137582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0fc8b-8115-42b0-b697-bc06da186cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:27.137582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0fc8b-8115-42b0-b697-bc06da186cc7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:27.139152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 693/1380] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:27.145766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2d674-cc9f-430a-95bd-1abd81083bb3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:27.146195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2d674-cc9f-430a-95bd-1abd81083bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:27.146368 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2d674-cc9f-430a-95bd-1abd81083bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:27.231788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-83b2d674-cc9f-430a-95bd-1abd81083bb3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:27.232942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-83b2d674-cc9f-430a-95bd-1abd81083bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:27.332267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:27.338840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 688/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:27.659180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0fc8b-8115-42b0-b697-bc06da186cc7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:27.661225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-74e0fc8b-8115-42b0-b697-bc06da186cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:27.803598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:27.818383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0fc8b-8115-42b0-b697-bc06da186cc7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:27.943833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a2fc2-43df-4d76-a2fb-542915780597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:27.944360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2fc2-43df-4d76-a2fb-542915780597 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:27.944647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2fc2-43df-4d76-a2fb-542915780597 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:27.944976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2fc2-43df-4d76-a2fb-542915780597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:27.946560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a85a2fc2-43df-4d76-a2fb-542915780597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:28.039497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a2fc2-43df-4d76-a2fb-542915780597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:28.041200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a2fc2-43df-4d76-a2fb-542915780597 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:28.052188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:28.061457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 694/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:30.601185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983fecb-7def-4b63-bd8c-37cb01208257 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:30.601807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983fecb-7def-4b63-bd8c-37cb01208257 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:30.601948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983fecb-7def-4b63-bd8c-37cb01208257 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:30.603692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 689/1383] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:30.609311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8f4b-7f06-4253-865e-9a0584a50aa4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:30.609938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8f4b-7f06-4253-865e-9a0584a50aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:30.609938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8f4b-7f06-4253-865e-9a0584a50aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:30.683649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ac0c8f4b-7f06-4253-865e-9a0584a50aa4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:30.684918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ac0c8f4b-7f06-4253-865e-9a0584a50aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:30.792304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 695/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:31.100017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983fecb-7def-4b63-bd8c-37cb01208257 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:31.102002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f983fecb-7def-4b63-bd8c-37cb01208257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:31.267423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983fecb-7def-4b63-bd8c-37cb01208257 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:31.350754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:31.402505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf865e35-35fe-4826-b86e-48ec06a7dcd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:31.403285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865e35-35fe-4826-b86e-48ec06a7dcd3 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:31.403638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865e35-35fe-4826-b86e-48ec06a7dcd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:31.404277 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865e35-35fe-4826-b86e-48ec06a7dcd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:31.406453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cf865e35-35fe-4826-b86e-48ec06a7dcd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:31.526612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf865e35-35fe-4826-b86e-48ec06a7dcd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:31.530422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf865e35-35fe-4826-b86e-48ec06a7dcd3 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:31.566560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 690/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:33.783830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75e77e-4bee-47c9-ba7e-4f7a1fff17c7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:33.784359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75e77e-4bee-47c9-ba7e-4f7a1fff17c7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:33.784359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75e77e-4bee-47c9-ba7e-4f7a1fff17c7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:33.785815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 696/1386] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:33.792123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6197-9c11-4deb-9128-b073c91a89bf None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:33.792574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6197-9c11-4deb-9128-b073c91a89bf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:33.792872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6197-9c11-4deb-9128-b073c91a89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:33.882364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-928e6197-9c11-4deb-9128-b073c91a89bf None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:33.883742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-928e6197-9c11-4deb-9128-b073c91a89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:33.921286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:33.985424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 691/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:34.278691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75e77e-4bee-47c9-ba7e-4f7a1fff17c7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:34.280238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0a75e77e-4bee-47c9-ba7e-4f7a1fff17c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:34.366648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:34.450043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75e77e-4bee-47c9-ba7e-4f7a1fff17c7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:34.572606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7a123-19ea-4e51-b787-733ee3a6cb2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:34.573137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a123-19ea-4e51-b787-733ee3a6cb2c service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:34.573440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a123-19ea-4e51-b787-733ee3a6cb2c service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:34.573708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a123-19ea-4e51-b787-733ee3a6cb2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:34.575287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bca7a123-19ea-4e51-b787-733ee3a6cb2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:34.615485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:34.669247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7a123-19ea-4e51-b787-733ee3a6cb2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:34.670900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7a123-19ea-4e51-b787-733ee3a6cb2c service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:34.688728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 697/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:36.555594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcccdf3-1f15-43a4-af0a-3e03856f103f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:36.556142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcccdf3-1f15-43a4-af0a-3e03856f103f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:36.556142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcccdf3-1f15-43a4-af0a-3e03856f103f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:36.557510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 692/1389] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:36.562839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b715-46e6-4c50-a2e3-49404df87ba8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:36.563252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b715-46e6-4c50-a2e3-49404df87ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:36.563412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b715-46e6-4c50-a2e3-49404df87ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:36.632974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6ef1b715-46e6-4c50-a2e3-49404df87ba8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:36.634572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6ef1b715-46e6-4c50-a2e3-49404df87ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:36.734182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 698/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:06:36.859020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746d36-363a-42a8-a6ef-939d0f9e9f21 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:36.859206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746d36-363a-42a8-a6ef-939d0f9e9f21 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:36.859481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20746d36-363a-42a8-a6ef-939d0f9e9f21 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:36.860822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 693/1391] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:36.866546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef616-cd50-430d-bdc2-51e763ec2832 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:36.866832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef616-cd50-430d-bdc2-51e763ec2832 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:36.867108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef616-cd50-430d-bdc2-51e763ec2832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:36.882974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:36.934346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-526ef616-cd50-430d-bdc2-51e763ec2832 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:36.935546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-526ef616-cd50-430d-bdc2-51e763ec2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:37.032698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0d0ee-e8ce-44a0-b2f8-a7e8a4e810f4 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:37.033061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0d0ee-e8ce-44a0-b2f8-a7e8a4e810f4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:37.033421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0d0ee-e8ce-44a0-b2f8-a7e8a4e810f4 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:37.035584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 694/1392] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 8 01:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:06:37.036722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 699/1393] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:37.041092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced6ba-3aaf-4322-8bbe-387d8ea3bbb8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:37.041518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced6ba-3aaf-4322-8bbe-387d8ea3bbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:37.041891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced6ba-3aaf-4322-8bbe-387d8ea3bbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:37.115953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7dced6ba-3aaf-4322-8bbe-387d8ea3bbb8 None None] MFA Rules not processed for user `21d637726e3142e6ba90fa201c764b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:37.117058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7dced6ba-3aaf-4322-8bbe-387d8ea3bbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:37.192720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 695/1394] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 8 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:06:37.201950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef616-cd50-430d-bdc2-51e763ec2832 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:37.203232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-526ef616-cd50-430d-bdc2-51e763ec2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:37.296565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef616-cd50-430d-bdc2-51e763ec2832 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:37.304104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:37.322437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dced6ba-3aaf-4322-8bbe-387d8ea3bbb8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:37.323628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7dced6ba-3aaf-4322-8bbe-387d8ea3bbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:37.355145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:37.374367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f5d8a-69da-4f4a-b47b-c17fa86381cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d637726e3142e6ba90fa201c764b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:37.374898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5d8a-69da-4f4a-b47b-c17fa86381cf service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:37.375171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5d8a-69da-4f4a-b47b-c17fa86381cf service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:37.375434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5d8a-69da-4f4a-b47b-c17fa86381cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:37.377120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ee8f5d8a-69da-4f4a-b47b-c17fa86381cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:37.445271 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dced6ba-3aaf-4322-8bbe-387d8ea3bbb8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:37.487773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f5d8a-69da-4f4a-b47b-c17fa86381cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:37.489220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f5d8a-69da-4f4a-b47b-c17fa86381cf service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:37.507472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 700/1395] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:37.565588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b0d5-633a-437e-bce6-fe55fe8e5903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:37.566194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b0d5-633a-437e-bce6-fe55fe8e5903 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:37.566469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b0d5-633a-437e-bce6-fe55fe8e5903 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:37.566738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b0d5-633a-437e-bce6-fe55fe8e5903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:37.568302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c811b0d5-633a-437e-bce6-fe55fe8e5903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:37.586933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:37.660778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b0d5-633a-437e-bce6-fe55fe8e5903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:37.662407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b0d5-633a-437e-bce6-fe55fe8e5903 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:37.680346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 696/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:06:38.275629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378181-a731-4656-b2b8-068d0918ae66 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:38.276152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378181-a731-4656-b2b8-068d0918ae66 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:38.276257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378181-a731-4656-b2b8-068d0918ae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:38.329793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:38.354813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-40378181-a731-4656-b2b8-068d0918ae66 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:38.356058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-40378181-a731-4656-b2b8-068d0918ae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:38.442731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 701/1397] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:38.485085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afccd9-76b8-423d-be74-b6f6bd34974c None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:38.485486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afccd9-76b8-423d-be74-b6f6bd34974c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:38.485834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afccd9-76b8-423d-be74-b6f6bd34974c None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:38.487296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 697/1398] 10.222.0.20 () {54 vars in 943 bytes} [Thu Sep 8 01:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:38.493509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360c59b-c0e9-43ca-aa37-ab0194c1ace4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:38.493802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360c59b-c0e9-43ca-aa37-ab0194c1ace4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:38.494223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360c59b-c0e9-43ca-aa37-ab0194c1ace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:38.572343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d360c59b-c0e9-43ca-aa37-ab0194c1ace4 None None] MFA Rules not processed for user `3c3d9f448692440fbeee652da473fd05`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:38.573567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d360c59b-c0e9-43ca-aa37-ab0194c1ace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:38.639287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:38.684417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 702/1399] 10.222.0.20 () {58 vars in 1040 bytes} [Thu Sep 8 01:06:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:38.694554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afccd9-76b8-423d-be74-b6f6bd34974c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:38.696167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-73afccd9-76b8-423d-be74-b6f6bd34974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:38.830788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afccd9-76b8-423d-be74-b6f6bd34974c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:38.839999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:38.937731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cbe58-97b5-4178-849d-ceaa3e0dd049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:38.938346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cbe58-97b5-4178-849d-ceaa3e0dd049 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:38.938627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cbe58-97b5-4178-849d-ceaa3e0dd049 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:38.938897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cbe58-97b5-4178-849d-ceaa3e0dd049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:38.940563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bb0cbe58-97b5-4178-849d-ceaa3e0dd049 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:39.024321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cbe58-97b5-4178-849d-ceaa3e0dd049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:39.025962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cbe58-97b5-4178-849d-ceaa3e0dd049 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:39.034550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 698/1400] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:06:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:06:39.870130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eec117-fb48-49e5-9979-612236430b07 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:39.870661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eec117-fb48-49e5-9979-612236430b07 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:39.870661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eec117-fb48-49e5-9979-612236430b07 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:39.871945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 703/1401] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:39.877374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778a73-f280-4b27-aeaa-05a3fe163b29 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:39.877858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778a73-f280-4b27-aeaa-05a3fe163b29 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:39.878028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778a73-f280-4b27-aeaa-05a3fe163b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:39.932712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:39.953092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-61778a73-f280-4b27-aeaa-05a3fe163b29 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:39.954400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-61778a73-f280-4b27-aeaa-05a3fe163b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:40.063021 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 699/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:40.356672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eec117-fb48-49e5-9979-612236430b07 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:40.358230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-21eec117-fb48-49e5-9979-612236430b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:40.538084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eec117-fb48-49e5-9979-612236430b07 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:40.582652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:40.671308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1699aab-7d6e-4687-9a37-7a8ef08d2b31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:40.672167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1699aab-7d6e-4687-9a37-7a8ef08d2b31 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:40.672513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1699aab-7d6e-4687-9a37-7a8ef08d2b31 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:40.672851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1699aab-7d6e-4687-9a37-7a8ef08d2b31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:40.674649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e1699aab-7d6e-4687-9a37-7a8ef08d2b31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:40.783377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1699aab-7d6e-4687-9a37-7a8ef08d2b31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:40.785705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1699aab-7d6e-4687-9a37-7a8ef08d2b31 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:40.804700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 704/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:43.056165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b70ce-8c12-4e62-8bd4-8bd81d77a508 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:43.056795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b70ce-8c12-4e62-8bd4-8bd81d77a508 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:43.056795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b70ce-8c12-4e62-8bd4-8bd81d77a508 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:43.058501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 700/1404] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:43.066242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ce29-7284-485b-9ad8-dd1a0c6be6b9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:43.066777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ce29-7284-485b-9ad8-dd1a0c6be6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:43.066777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ce29-7284-485b-9ad8-dd1a0c6be6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:43.128702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:43.138839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2ab1ce29-7284-485b-9ad8-dd1a0c6be6b9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:43.140334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2ab1ce29-7284-485b-9ad8-dd1a0c6be6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:43.245602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 705/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:43.542173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b70ce-8c12-4e62-8bd4-8bd81d77a508 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:43.543741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b15b70ce-8c12-4e62-8bd4-8bd81d77a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:43.678777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:43.715542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b70ce-8c12-4e62-8bd4-8bd81d77a508 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:43.848160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870aa04-3e25-43ad-af6c-950e6101707e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:43.848896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870aa04-3e25-43ad-af6c-950e6101707e service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:43.849175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870aa04-3e25-43ad-af6c-950e6101707e service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:43.849479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870aa04-3e25-43ad-af6c-950e6101707e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:43.851206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8870aa04-3e25-43ad-af6c-950e6101707e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:43.945754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:43.957915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870aa04-3e25-43ad-af6c-950e6101707e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:43.959524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870aa04-3e25-43ad-af6c-950e6101707e service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:43.978343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 701/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:46.178971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d20362-6700-4782-99a7-3eebcfd4c2dd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:46.179532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d20362-6700-4782-99a7-3eebcfd4c2dd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:46.179532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d20362-6700-4782-99a7-3eebcfd4c2dd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:46.180994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 706/1407] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:06:46.186152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830f719-cf6b-4b8f-ac40-1401bc89a535 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:46.186563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830f719-cf6b-4b8f-ac40-1401bc89a535 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:46.186810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830f719-cf6b-4b8f-ac40-1401bc89a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:46.260583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2830f719-cf6b-4b8f-ac40-1401bc89a535 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:06:46.261968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2830f719-cf6b-4b8f-ac40-1401bc89a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:46.369243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 702/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:06:46.656473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d20362-6700-4782-99a7-3eebcfd4c2dd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:06:46.658082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a8d20362-6700-4782-99a7-3eebcfd4c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:46.791499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:46.819457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d20362-6700-4782-99a7-3eebcfd4c2dd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:06:46.950228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3e9d5-187b-4ec9-8602-467b245909c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:06:46.950837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3e9d5-187b-4ec9-8602-467b245909c0 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:06:46.951124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3e9d5-187b-4ec9-8602-467b245909c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:06:46.951996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3e9d5-187b-4ec9-8602-467b245909c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:06:46.953013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-35e3e9d5-187b-4ec9-8602-467b245909c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:06:47.053140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:47.057005 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3e9d5-187b-4ec9-8602-467b245909c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:06:47.058964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3e9d5-187b-4ec9-8602-467b245909c0 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:06:47.078472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 707/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:06:56.367301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=74 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:57.076054 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:01.724555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04b9ed-880c-4f70-8582-7bdebb157bd8 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:01.725143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04b9ed-880c-4f70-8582-7bdebb157bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:01.725143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04b9ed-880c-4f70-8582-7bdebb157bd8 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:01.726549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 703/1410] 10.222.0.20 () {54 vars in 918 bytes} [Thu Sep 8 01:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:01.731692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441b04-de94-47bb-9330-b08e0dc3f0ab None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:01.732141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441b04-de94-47bb-9330-b08e0dc3f0ab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:01.732249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441b04-de94-47bb-9330-b08e0dc3f0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:01.806725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7b441b04-de94-47bb-9330-b08e0dc3f0ab None None] MFA Rules not processed for user `e7e636a8e4704971ae840035f3fc4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:01.807914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7b441b04-de94-47bb-9330-b08e0dc3f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:01.911198 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 708/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Sep 8 01:07:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:01.926007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657da6-ac0d-48c9-b2b4-ef00ebda3876 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:01.926298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657da6-ac0d-48c9-b2b4-ef00ebda3876 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:01.926577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657da6-ac0d-48c9-b2b4-ef00ebda3876 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:01.927927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 704/1412] 10.222.0.20 () {54 vars in 918 bytes} [Thu Sep 8 01:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:01.932611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ab5ea-1d4f-439a-ad0b-f7c695fe4bc3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:01.932893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ab5ea-1d4f-439a-ad0b-f7c695fe4bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:01.933165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ab5ea-1d4f-439a-ad0b-f7c695fe4bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:02.005178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:02.009339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-572ab5ea-1d4f-439a-ad0b-f7c695fe4bc3 None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:02.011357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-572ab5ea-1d4f-439a-ad0b-f7c695fe4bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:02.126990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 709/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Sep 8 01:07:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:04.680999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccc28a-476f-4e27-a065-3666de55883a None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:04.681598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccc28a-476f-4e27-a065-3666de55883a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:04.681598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccc28a-476f-4e27-a065-3666de55883a None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:04.682955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:04.688352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe56e1-3c4d-4417-85f3-99a1faa35754 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:04.688788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe56e1-3c4d-4417-85f3-99a1faa35754 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:04.688912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe56e1-3c4d-4417-85f3-99a1faa35754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:04.758274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-95fe56e1-3c4d-4417-85f3-99a1faa35754 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:04.759534 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-95fe56e1-3c4d-4417-85f3-99a1faa35754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:04.815386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:04.857157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:05.147397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccc28a-476f-4e27-a065-3666de55883a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:05.149070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-95ccc28a-476f-4e27-a065-3666de55883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:05.293239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccc28a-476f-4e27-a065-3666de55883a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:05.365317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:05.405712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe8e92-6d45-4454-83b4-3ba005aa3fce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:05.406248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe8e92-6d45-4454-83b4-3ba005aa3fce service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:05.406532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe8e92-6d45-4454-83b4-3ba005aa3fce service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:05.406804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe8e92-6d45-4454-83b4-3ba005aa3fce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:05.408389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-40fe8e92-6d45-4454-83b4-3ba005aa3fce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:05.496365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe8e92-6d45-4454-83b4-3ba005aa3fce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:05.497984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe8e92-6d45-4454-83b4-3ba005aa3fce service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:05.516433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 706/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:06.639448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579a4f-16e1-478f-aa37-12b6790c0b0e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:06.640027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579a4f-16e1-478f-aa37-12b6790c0b0e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:06.640027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579a4f-16e1-478f-aa37-12b6790c0b0e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:06.641451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:06.647646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806750-c729-4641-9d84-83b82aff17a4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:06.648071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806750-c729-4641-9d84-83b82aff17a4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:06.648188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806750-c729-4641-9d84-83b82aff17a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:06.724408 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7b806750-c729-4641-9d84-83b82aff17a4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:06.725651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7b806750-c729-4641-9d84-83b82aff17a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:06.753459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:06.824958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:06.975478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579a4f-16e1-478f-aa37-12b6790c0b0e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:06.977032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-33579a4f-16e1-478f-aa37-12b6790c0b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:07.121166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579a4f-16e1-478f-aa37-12b6790c0b0e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:07.161324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:07.234040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0effc98-4d1c-4c80-92bf-fd4fb5ec336b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:07.235135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0effc98-4d1c-4c80-92bf-fd4fb5ec336b service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:07.235409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0effc98-4d1c-4c80-92bf-fd4fb5ec336b service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:07.235677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0effc98-4d1c-4c80-92bf-fd4fb5ec336b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:07.237280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d0effc98-4d1c-4c80-92bf-fd4fb5ec336b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:07.327127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0effc98-4d1c-4c80-92bf-fd4fb5ec336b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:07.328715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0effc98-4d1c-4c80-92bf-fd4fb5ec336b service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:07.346657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 712/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:08.470143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82b21-ed44-48ac-9d92-365c3c53cf41 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:08.470709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82b21-ed44-48ac-9d92-365c3c53cf41 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:08.470709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82b21-ed44-48ac-9d92-365c3c53cf41 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:08.472009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:08.478401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68630-9dd5-403e-abf7-e87722c946ae None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:08.478847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68630-9dd5-403e-abf7-e87722c946ae None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:08.478955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68630-9dd5-403e-abf7-e87722c946ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:08.534043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:08.556158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-00d68630-9dd5-403e-abf7-e87722c946ae None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:08.557327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-00d68630-9dd5-403e-abf7-e87722c946ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:08.652085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:08.802889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82b21-ed44-48ac-9d92-365c3c53cf41 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:08.804414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-59b82b21-ed44-48ac-9d92-365c3c53cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:08.950006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82b21-ed44-48ac-9d92-365c3c53cf41 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:08.962676 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:09.067286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a0ca8-264f-422d-b26f-48eeeca81fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:09.067894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a0ca8-264f-422d-b26f-48eeeca81fcb service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:09.068175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a0ca8-264f-422d-b26f-48eeeca81fcb service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:09.068450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a0ca8-264f-422d-b26f-48eeeca81fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:09.070123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-200a0ca8-264f-422d-b26f-48eeeca81fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:09.159635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a0ca8-264f-422d-b26f-48eeeca81fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:09.161245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a0ca8-264f-422d-b26f-48eeeca81fcb service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:09.179238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 709/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:10.277122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd9606-2339-4612-abe7-c6f35c50b716 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:10.277630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd9606-2339-4612-abe7-c6f35c50b716 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:10.277739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd9606-2339-4612-abe7-c6f35c50b716 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:10.279130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:10.285380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d285-34aa-4fba-9786-f64b79eac380 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:10.285808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d285-34aa-4fba-9786-f64b79eac380 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:10.285958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d285-34aa-4fba-9786-f64b79eac380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:10.305475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:10.363719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8db0d285-34aa-4fba-9786-f64b79eac380 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:10.364948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8db0d285-34aa-4fba-9786-f64b79eac380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:10.460176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:10.608376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd9606-2339-4612-abe7-c6f35c50b716 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:10.610364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d8fd9606-2339-4612-abe7-c6f35c50b716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:10.717642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:10.754002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd9606-2339-4612-abe7-c6f35c50b716 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:10.865917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ed6a3-df08-49e5-b588-2d7ac68cecd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:10.866450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed6a3-df08-49e5-b588-2d7ac68cecd1 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:10.866732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed6a3-df08-49e5-b588-2d7ac68cecd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:10.867004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ed6a3-df08-49e5-b588-2d7ac68cecd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:10.868612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-982ed6a3-df08-49e5-b588-2d7ac68cecd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:10.945146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:10.958632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ed6a3-df08-49e5-b588-2d7ac68cecd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:10.960246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ed6a3-df08-49e5-b588-2d7ac68cecd1 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:10.977960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 715/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:12.075572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05abd-00ea-4b39-9483-8e82ce2e229f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:12.076164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05abd-00ea-4b39-9483-8e82ce2e229f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:12.076164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05abd-00ea-4b39-9483-8e82ce2e229f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:12.077499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:12.084183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9735-8f3e-496e-913f-0c31818f1fab None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:12.084618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9735-8f3e-496e-913f-0c31818f1fab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:12.084718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9735-8f3e-496e-913f-0c31818f1fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:12.159649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5a0c9735-8f3e-496e-913f-0c31818f1fab None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:12.160850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5a0c9735-8f3e-496e-913f-0c31818f1fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:12.255040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:12.405554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e05abd-00ea-4b39-9483-8e82ce2e229f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:12.407064 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e0e05abd-00ea-4b39-9483-8e82ce2e229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:12.493891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:12.555801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e05abd-00ea-4b39-9483-8e82ce2e229f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:12.667117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad66396-73ba-4a02-a24c-1bfedd32b1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:12.667716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad66396-73ba-4a02-a24c-1bfedd32b1d6 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:12.667996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad66396-73ba-4a02-a24c-1bfedd32b1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:12.668269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad66396-73ba-4a02-a24c-1bfedd32b1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:12.669882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8ad66396-73ba-4a02-a24c-1bfedd32b1d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:12.717205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:12.758127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad66396-73ba-4a02-a24c-1bfedd32b1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:12.759628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad66396-73ba-4a02-a24c-1bfedd32b1d6 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:12.777969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 712/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:13.825647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca493da-f456-40b6-994f-0168d0cc074f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:13.826211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca493da-f456-40b6-994f-0168d0cc074f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:13.826211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca493da-f456-40b6-994f-0168d0cc074f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:13.828070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:13.834493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3d1cb-b7cd-4efb-b020-f6da7e831785 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:13.834922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3d1cb-b7cd-4efb-b020-f6da7e831785 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:13.835023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3d1cb-b7cd-4efb-b020-f6da7e831785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:13.912479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1db3d1cb-b7cd-4efb-b020-f6da7e831785 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:13.913723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1db3d1cb-b7cd-4efb-b020-f6da7e831785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:14.009588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:07:14.171731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca493da-f456-40b6-994f-0168d0cc074f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:14.173672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9ca493da-f456-40b6-994f-0168d0cc074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:14.222233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:14.318129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca493da-f456-40b6-994f-0168d0cc074f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:14.433277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4bbd3-2a53-4660-af7e-f2cc9cc06438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:14.433823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4bbd3-2a53-4660-af7e-f2cc9cc06438 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:14.434097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4bbd3-2a53-4660-af7e-f2cc9cc06438 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:14.434361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4bbd3-2a53-4660-af7e-f2cc9cc06438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:14.435942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f2f4bbd3-2a53-4660-af7e-f2cc9cc06438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:14.443573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:14.526829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4bbd3-2a53-4660-af7e-f2cc9cc06438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:14.528434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4bbd3-2a53-4660-af7e-f2cc9cc06438 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:14.546092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 718/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:15.615827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b1a29-5898-4709-b838-41948da50e9b None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:15.616364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b1a29-5898-4709-b838-41948da50e9b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:15.616364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b1a29-5898-4709-b838-41948da50e9b None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:15.617694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:15.623943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26664-cd71-4ef7-a789-8b33898f8ce9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:15.624875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26664-cd71-4ef7-a789-8b33898f8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:15.625008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d26664-cd71-4ef7-a789-8b33898f8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:15.698605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-63d26664-cd71-4ef7-a789-8b33898f8ce9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:15.699795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-63d26664-cd71-4ef7-a789-8b33898f8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:15.765940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:15.794022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:15.942403 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b1a29-5898-4709-b838-41948da50e9b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:15.944013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-784b1a29-5898-4709-b838-41948da50e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:15.962407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:16.087073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b1a29-5898-4709-b838-41948da50e9b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:16.172979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:16.199469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c75d79-e343-4ef6-b6dc-fe5f533df8d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:16.200005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c75d79-e343-4ef6-b6dc-fe5f533df8d7 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:16.200281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c75d79-e343-4ef6-b6dc-fe5f533df8d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:16.200551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c75d79-e343-4ef6-b6dc-fe5f533df8d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:16.202161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-41c75d79-e343-4ef6-b6dc-fe5f533df8d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:16.290500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c75d79-e343-4ef6-b6dc-fe5f533df8d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:16.292074 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c75d79-e343-4ef6-b6dc-fe5f533df8d7 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:16.309546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 715/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:17.351780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e480a87-65b5-4a1c-87a0-7b7637362502 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:17.352261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e480a87-65b5-4a1c-87a0-7b7637362502 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:17.352371 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e480a87-65b5-4a1c-87a0-7b7637362502 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:17.353737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:17.359867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e15c7-332e-4db4-8202-23ec075bf382 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:17.360252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e15c7-332e-4db4-8202-23ec075bf382 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:17.360420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e15c7-332e-4db4-8202-23ec075bf382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:17.435599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-186e15c7-332e-4db4-8202-23ec075bf382 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:17.436798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-186e15c7-332e-4db4-8202-23ec075bf382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:17.477965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:17.532839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:17.682017 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e480a87-65b5-4a1c-87a0-7b7637362502 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:17.683616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4e480a87-65b5-4a1c-87a0-7b7637362502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:17.845845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e480a87-65b5-4a1c-87a0-7b7637362502 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:17.908310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:17.966677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aede319-9975-4206-ad8f-beb9054c3bb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:17.967291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede319-9975-4206-ad8f-beb9054c3bb1 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:17.967570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede319-9975-4206-ad8f-beb9054c3bb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:17.967880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aede319-9975-4206-ad8f-beb9054c3bb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:17.969593 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8aede319-9975-4206-ad8f-beb9054c3bb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:18.057850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aede319-9975-4206-ad8f-beb9054c3bb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:18.059487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aede319-9975-4206-ad8f-beb9054c3bb1 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:18.078284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 721/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:19.144335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a51a50-8252-49e1-bff8-3d3a55657908 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:19.144901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a51a50-8252-49e1-bff8-3d3a55657908 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:19.145008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a51a50-8252-49e1-bff8-3d3a55657908 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:19.146341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:07:19.152320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eca5f-95ed-4271-8ffb-36881cee02ad None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:19.152770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eca5f-95ed-4271-8ffb-36881cee02ad None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:19.152902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eca5f-95ed-4271-8ffb-36881cee02ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:19.231925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7e3eca5f-95ed-4271-8ffb-36881cee02ad None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:19.233127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7e3eca5f-95ed-4271-8ffb-36881cee02ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:19.235622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:19.329644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:19.475976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a51a50-8252-49e1-bff8-3d3a55657908 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:19.477429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e2a51a50-8252-49e1-bff8-3d3a55657908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:19.623419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a51a50-8252-49e1-bff8-3d3a55657908 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:19.650944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:19.735256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219c7b-4f9e-4fa3-9d4a-3a25d6e3276c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:19.735789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219c7b-4f9e-4fa3-9d4a-3a25d6e3276c service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:19.736065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219c7b-4f9e-4fa3-9d4a-3a25d6e3276c service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:19.736335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219c7b-4f9e-4fa3-9d4a-3a25d6e3276c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:19.737963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a0219c7b-4f9e-4fa3-9d4a-3a25d6e3276c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:19.837446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0219c7b-4f9e-4fa3-9d4a-3a25d6e3276c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:19.839030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0219c7b-4f9e-4fa3-9d4a-3a25d6e3276c service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:19.856756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 718/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:21.914779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5d68c-b1fa-46b1-8ab0-ebc0b8d55ce0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:21.915325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5d68c-b1fa-46b1-8ab0-ebc0b8d55ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:21.915325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5d68c-b1fa-46b1-8ab0-ebc0b8d55ce0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:21.916684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:21.922695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd0bb-0bf0-46ca-b4bc-da944156f2db None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:21.923118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd0bb-0bf0-46ca-b4bc-da944156f2db None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:21.923280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abd0bb-0bf0-46ca-b4bc-da944156f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:21.963696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:21.989547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-46abd0bb-0bf0-46ca-b4bc-da944156f2db None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:21.990745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-46abd0bb-0bf0-46ca-b4bc-da944156f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:22.086182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:07:22.373783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5d68c-b1fa-46b1-8ab0-ebc0b8d55ce0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:22.375349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-55b5d68c-b1fa-46b1-8ab0-ebc0b8d55ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:22.477728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5d68c-b1fa-46b1-8ab0-ebc0b8d55ce0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:22.510004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:22.553332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405540bf-341d-47a8-9f4b-6072a554b6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:22.553973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405540bf-341d-47a8-9f4b-6072a554b6df service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:22.554255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405540bf-341d-47a8-9f4b-6072a554b6df service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:22.554530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405540bf-341d-47a8-9f4b-6072a554b6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:22.556124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-405540bf-341d-47a8-9f4b-6072a554b6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:22.664062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405540bf-341d-47a8-9f4b-6072a554b6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:22.665539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405540bf-341d-47a8-9f4b-6072a554b6df service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:22.683242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 724/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:25.037153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f67d24-6187-4565-81eb-0dc915d95c6e None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:25.037734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f67d24-6187-4565-81eb-0dc915d95c6e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:25.037734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f67d24-6187-4565-81eb-0dc915d95c6e None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:25.039088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:25.044203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699be89-e8e7-4662-9e63-a360425dfba1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:25.044607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699be89-e8e7-4662-9e63-a360425dfba1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:25.044752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699be89-e8e7-4662-9e63-a360425dfba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:25.110532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0699be89-e8e7-4662-9e63-a360425dfba1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:25.111730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0699be89-e8e7-4662-9e63-a360425dfba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:25.124141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:25.207010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:25.490891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f67d24-6187-4565-81eb-0dc915d95c6e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:25.492429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-59f67d24-6187-4565-81eb-0dc915d95c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:25.596177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f67d24-6187-4565-81eb-0dc915d95c6e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:25.609265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:25.669623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215fec2-5d9f-4f0b-ae28-33b39a62994c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:25.670227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215fec2-5d9f-4f0b-ae28-33b39a62994c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:25.671011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215fec2-5d9f-4f0b-ae28-33b39a62994c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:25.671289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215fec2-5d9f-4f0b-ae28-33b39a62994c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:25.672882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6215fec2-5d9f-4f0b-ae28-33b39a62994c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:25.781145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215fec2-5d9f-4f0b-ae28-33b39a62994c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:25.782546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215fec2-5d9f-4f0b-ae28-33b39a62994c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:25.800633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 721/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:28.229573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b036a10-cdd2-466a-9210-a988dba715d5 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:28.230132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b036a10-cdd2-466a-9210-a988dba715d5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:28.230132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b036a10-cdd2-466a-9210-a988dba715d5 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:28.231515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:28.237509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848785de-9c83-4207-8d98-85b96b40909d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:28.238112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848785de-9c83-4207-8d98-85b96b40909d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:28.238112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848785de-9c83-4207-8d98-85b96b40909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:28.288987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:28.307590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-848785de-9c83-4207-8d98-85b96b40909d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:28.308814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-848785de-9c83-4207-8d98-85b96b40909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:28.404647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:28.687471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b036a10-cdd2-466a-9210-a988dba715d5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:28.689000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7b036a10-cdd2-466a-9210-a988dba715d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:28.791713 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b036a10-cdd2-466a-9210-a988dba715d5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:28.831768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:28.864660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a1eb8-ad80-4fe4-92ad-194cdf091d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:28.865261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1eb8-ad80-4fe4-92ad-194cdf091d72 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:28.865569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1eb8-ad80-4fe4-92ad-194cdf091d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:28.865844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1eb8-ad80-4fe4-92ad-194cdf091d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:28.867428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-680a1eb8-ad80-4fe4-92ad-194cdf091d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:28.979206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a1eb8-ad80-4fe4-92ad-194cdf091d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:28.980662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a1eb8-ad80-4fe4-92ad-194cdf091d72 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:28.998810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 727/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:31.256608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eb8f6-045b-41de-960d-42fa1ef4fedf None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:31.257180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eb8f6-045b-41de-960d-42fa1ef4fedf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:31.257180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eb8f6-045b-41de-960d-42fa1ef4fedf None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:31.258570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:31.264775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3930-859a-4588-975a-f45e1b257d5a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:31.265197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3930-859a-4588-975a-f45e1b257d5a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:31.265308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3930-859a-4588-975a-f45e1b257d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:31.331511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-83bf3930-859a-4588-975a-f45e1b257d5a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:31.332704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-83bf3930-859a-4588-975a-f45e1b257d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:31.352598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:31.427810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:31.708978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eb8f6-045b-41de-960d-42fa1ef4fedf None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:31.710613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-617eb8f6-045b-41de-960d-42fa1ef4fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:31.813086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eb8f6-045b-41de-960d-42fa1ef4fedf None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:31.833594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:31.886653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4a1b8-462a-4795-8472-4dc4075a5881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:31.887257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4a1b8-462a-4795-8472-4dc4075a5881 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:31.887535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4a1b8-462a-4795-8472-4dc4075a5881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:31.888058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4a1b8-462a-4795-8472-4dc4075a5881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:31.890196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f2e4a1b8-462a-4795-8472-4dc4075a5881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:31.998447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4a1b8-462a-4795-8472-4dc4075a5881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:31.999874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4a1b8-462a-4795-8472-4dc4075a5881 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:32.018127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 724/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:34.192055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de96f-7986-43fc-b90e-4afda6389118 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:34.192594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de96f-7986-43fc-b90e-4afda6389118 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:34.192594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de96f-7986-43fc-b90e-4afda6389118 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:34.193990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:34.199375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968fb1-db5e-4e6d-bbaa-f377d0f82216 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:34.199770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968fb1-db5e-4e6d-bbaa-f377d0f82216 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:34.199957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968fb1-db5e-4e6d-bbaa-f377d0f82216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:34.263698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:34.266778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0e968fb1-db5e-4e6d-bbaa-f377d0f82216 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:34.268607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0e968fb1-db5e-4e6d-bbaa-f377d0f82216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:34.364881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:34.648318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29de96f-7986-43fc-b90e-4afda6389118 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:34.649893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f29de96f-7986-43fc-b90e-4afda6389118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:34.753057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29de96f-7986-43fc-b90e-4afda6389118 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:34.803469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:34.828063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4c38f-6fbe-41e7-ba79-279cc4d24c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:34.828657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4c38f-6fbe-41e7-ba79-279cc4d24c10 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:34.828941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4c38f-6fbe-41e7-ba79-279cc4d24c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:34.829209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4c38f-6fbe-41e7-ba79-279cc4d24c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:34.830809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-efc4c38f-6fbe-41e7-ba79-279cc4d24c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:34.938088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4c38f-6fbe-41e7-ba79-279cc4d24c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:34.939520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4c38f-6fbe-41e7-ba79-279cc4d24c10 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:34.958163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 730/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:37.167263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0c3e9-9fa4-49bb-bd9d-5785c43d39ed None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:37.167801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0c3e9-9fa4-49bb-bd9d-5785c43d39ed None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:37.167801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0c3e9-9fa4-49bb-bd9d-5785c43d39ed None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:37.169161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:37.174995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1579-81ad-4505-a43a-cdf6fdabc3c6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:37.175399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1579-81ad-4505-a43a-cdf6fdabc3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:37.175544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1579-81ad-4505-a43a-cdf6fdabc3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:37.239560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-037f1579-81ad-4505-a43a-cdf6fdabc3c6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:37.240751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-037f1579-81ad-4505-a43a-cdf6fdabc3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:37.269582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:37.338211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:37.622750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0c3e9-9fa4-49bb-bd9d-5785c43d39ed None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:37.624300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-47c0c3e9-9fa4-49bb-bd9d-5785c43d39ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:37.727099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0c3e9-9fa4-49bb-bd9d-5785c43d39ed None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:37.754841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:37.800507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4004ed-221f-4040-a6d1-67feca65ec3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:37.801033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4004ed-221f-4040-a6d1-67feca65ec3b service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:37.801312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4004ed-221f-4040-a6d1-67feca65ec3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:37.801658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4004ed-221f-4040-a6d1-67feca65ec3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:37.803280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ff4004ed-221f-4040-a6d1-67feca65ec3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:37.911371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4004ed-221f-4040-a6d1-67feca65ec3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:37.912802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4004ed-221f-4040-a6d1-67feca65ec3b service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:37.931100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 727/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:40.079423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b671-b3cc-4ed3-b0ac-be63af70f8ea None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:40.079963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b671-b3cc-4ed3-b0ac-be63af70f8ea None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:40.079963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b671-b3cc-4ed3-b0ac-be63af70f8ea None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:40.081372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:40.086539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc4319-3259-4d36-b5f3-5f8c92b30682 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:40.086972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc4319-3259-4d36-b5f3-5f8c92b30682 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:40.087132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc4319-3259-4d36-b5f3-5f8c92b30682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:40.153338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2adc4319-3259-4d36-b5f3-5f8c92b30682 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:40.155199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2adc4319-3259-4d36-b5f3-5f8c92b30682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:40.163534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:40.252705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:40.532814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6b671-b3cc-4ed3-b0ac-be63af70f8ea None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:40.534400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-68c6b671-b3cc-4ed3-b0ac-be63af70f8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:40.639953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6b671-b3cc-4ed3-b0ac-be63af70f8ea None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:40.694185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:40.712403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec834a-b50e-4dcd-9cee-7ab4ddaed428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:40.713003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec834a-b50e-4dcd-9cee-7ab4ddaed428 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:40.713278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec834a-b50e-4dcd-9cee-7ab4ddaed428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:40.713578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec834a-b50e-4dcd-9cee-7ab4ddaed428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:40.715149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-47ec834a-b50e-4dcd-9cee-7ab4ddaed428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:40.823536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec834a-b50e-4dcd-9cee-7ab4ddaed428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:40.824903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec834a-b50e-4dcd-9cee-7ab4ddaed428 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:40.843737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 733/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:43.019497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db08b-2188-4ed4-8638-0258e19671b0 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:43.020102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db08b-2188-4ed4-8638-0258e19671b0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:43.020102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658db08b-2188-4ed4-8638-0258e19671b0 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:43.021460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:43.026622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921baf-d47a-455a-9644-75a2f8f43996 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:43.027062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921baf-d47a-455a-9644-75a2f8f43996 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:43.027185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921baf-d47a-455a-9644-75a2f8f43996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:43.091715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-06921baf-d47a-455a-9644-75a2f8f43996 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:43.092906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-06921baf-d47a-455a-9644-75a2f8f43996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:43.131437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:43.189262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:43.470546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658db08b-2188-4ed4-8638-0258e19671b0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:43.472075 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-658db08b-2188-4ed4-8638-0258e19671b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:43.578374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658db08b-2188-4ed4-8638-0258e19671b0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:43.620421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:43.658167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b0be5-998a-43fc-a4d5-7ce7418721cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:43.658776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b0be5-998a-43fc-a4d5-7ce7418721cd service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:43.659056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b0be5-998a-43fc-a4d5-7ce7418721cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:43.659330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b0be5-998a-43fc-a4d5-7ce7418721cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:43.660930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4f6b0be5-998a-43fc-a4d5-7ce7418721cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:43.771520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b0be5-998a-43fc-a4d5-7ce7418721cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:43.772951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b0be5-998a-43fc-a4d5-7ce7418721cd service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:43.791219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 730/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:45.946992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ebe68-e03b-4f08-b9d4-67f482c3fb7b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:45.947559 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ebe68-e03b-4f08-b9d4-67f482c3fb7b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:45.947559 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ebe68-e03b-4f08-b9d4-67f482c3fb7b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:45.948876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:45.954663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd198-429b-4520-9b00-3a1aa203a539 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:45.955114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd198-429b-4520-9b00-3a1aa203a539 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:45.955212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd198-429b-4520-9b00-3a1aa203a539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:46.022347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b56dd198-429b-4520-9b00-3a1aa203a539 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:46.023550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b56dd198-429b-4520-9b00-3a1aa203a539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:46.041695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:46.119208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:46.401456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ebe68-e03b-4f08-b9d4-67f482c3fb7b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:46.402984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ee1ebe68-e03b-4f08-b9d4-67f482c3fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:46.505571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ebe68-e03b-4f08-b9d4-67f482c3fb7b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:46.573612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:46.580693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f0b41-7269-4140-81d1-03fe39333e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:46.581302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f0b41-7269-4140-81d1-03fe39333e6a service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:46.582229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f0b41-7269-4140-81d1-03fe39333e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:46.582514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f0b41-7269-4140-81d1-03fe39333e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:46.584120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-094f0b41-7269-4140-81d1-03fe39333e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:46.696073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f0b41-7269-4140-81d1-03fe39333e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:46.697476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f0b41-7269-4140-81d1-03fe39333e6a service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:46.716636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 736/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:48.859000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cf12d-a317-463a-8c05-c9c3a37e0389 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:48.859529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cf12d-a317-463a-8c05-c9c3a37e0389 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:48.859529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cf12d-a317-463a-8c05-c9c3a37e0389 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:48.860928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:07:48.866338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ec04-d7e4-4e5e-b0bd-9ad902d8d125 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:48.866775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ec04-d7e4-4e5e-b0bd-9ad902d8d125 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:48.866881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ec04-d7e4-4e5e-b0bd-9ad902d8d125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:48.936375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8253ec04-d7e4-4e5e-b0bd-9ad902d8d125 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:07:48.938368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8253ec04-d7e4-4e5e-b0bd-9ad902d8d125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:48.993419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:49.042485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:07:49.323836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cf12d-a317-463a-8c05-c9c3a37e0389 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:07:49.326010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-556cf12d-a317-463a-8c05-c9c3a37e0389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:49.428211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cf12d-a317-463a-8c05-c9c3a37e0389 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:07:49.476319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:49.501937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff032e13-dabe-4194-9f04-1168b23bc03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:07:49.502540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032e13-dabe-4194-9f04-1168b23bc03a service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:07:49.502820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032e13-dabe-4194-9f04-1168b23bc03a service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:07:49.503170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032e13-dabe-4194-9f04-1168b23bc03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:07:49.504702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ff032e13-dabe-4194-9f04-1168b23bc03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:07:49.613967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff032e13-dabe-4194-9f04-1168b23bc03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:07:49.615307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff032e13-dabe-4194-9f04-1168b23bc03a service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:07:49.632840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 733/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:59.040947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=22 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:59.630588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=66 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:09.559452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456639c8-fccc-400e-8a53-6009cb33f02b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:09.559977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456639c8-fccc-400e-8a53-6009cb33f02b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:09.559977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456639c8-fccc-400e-8a53-6009cb33f02b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:09.561331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 738/1471] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:08:09.566914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9d8c-c738-437e-8e08-d6a5b96066d0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:09.567342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9d8c-c738-437e-8e08-d6a5b96066d0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:09.567447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9d8c-c738-437e-8e08-d6a5b96066d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:09.635299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5c9a9d8c-c738-437e-8e08-d6a5b96066d0 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:08:09.637708 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5c9a9d8c-c738-437e-8e08-d6a5b96066d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:09.737221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 734/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:08:10.039048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf05716-8d5f-42ff-b494-9f5e2b4a9725 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:10.039336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf05716-8d5f-42ff-b494-9f5e2b4a9725 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:10.039613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf05716-8d5f-42ff-b494-9f5e2b4a9725 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:10.040940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 739/1473] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 8 01:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:08:10.045864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fea29-b4e2-45bf-91fe-0b108537a08c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:10.046151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fea29-b4e2-45bf-91fe-0b108537a08c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:10.046422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fea29-b4e2-45bf-91fe-0b108537a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:10.121749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-301fea29-b4e2-45bf-91fe-0b108537a08c None None] MFA Rules not processed for user `21d637726e3142e6ba90fa201c764b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:08:10.122968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-301fea29-b4e2-45bf-91fe-0b108537a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:10.144333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:10.200383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 735/1474] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 8 01:08:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:08:10.208041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf05716-8d5f-42ff-b494-9f5e2b4a9725 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:08:10.209606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4bf05716-8d5f-42ff-b494-9f5e2b4a9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:10.313384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf05716-8d5f-42ff-b494-9f5e2b4a9725 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:08:10.386519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00917daf-a89a-4b33-90c1-4c900a945a65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d637726e3142e6ba90fa201c764b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:08:10.387122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917daf-a89a-4b33-90c1-4c900a945a65 service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:10.387400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917daf-a89a-4b33-90c1-4c900a945a65 service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:10.387673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917daf-a89a-4b33-90c1-4c900a945a65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:10.389270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-00917daf-a89a-4b33-90c1-4c900a945a65 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:10.441923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:10.497119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00917daf-a89a-4b33-90c1-4c900a945a65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:08:10.498563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00917daf-a89a-4b33-90c1-4c900a945a65 service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:08:10.518084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 740/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:08:12.753914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5da3c7-f730-4561-8f79-3a0ad8974477 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:12.754454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5da3c7-f730-4561-8f79-3a0ad8974477 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:12.754565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5da3c7-f730-4561-8f79-3a0ad8974477 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:12.755896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 736/1476] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:08:12.761292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1add541-189c-424a-b8f0-330a714da60d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:12.761769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1add541-189c-424a-b8f0-330a714da60d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:12.761865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1add541-189c-424a-b8f0-330a714da60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:12.826623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c1add541-189c-424a-b8f0-330a714da60d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:08:12.827851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c1add541-189c-424a-b8f0-330a714da60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:12.923784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 741/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:08:13.200616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5da3c7-f730-4561-8f79-3a0ad8974477 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:08:13.202188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3f5da3c7-f730-4561-8f79-3a0ad8974477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:13.327684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5da3c7-f730-4561-8f79-3a0ad8974477 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:08:13.376301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:13.420147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a728675-2331-4ff7-97c1-d13489e4cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:08:13.420746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a728675-2331-4ff7-97c1-d13489e4cac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:13.421020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a728675-2331-4ff7-97c1-d13489e4cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:13.421288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a728675-2331-4ff7-97c1-d13489e4cac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:13.421967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a728675-2331-4ff7-97c1-d13489e4cac3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:08:13.423644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-2a728675-2331-4ff7-97c1-d13489e4cac3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:08:13.423644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: warnings.warn(msg) Sep 08 01:08:13.423644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: Sep 08 01:08:13.424776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a728675-2331-4ff7-97c1-d13489e4cac3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:08:13.445087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 737/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Sep 8 01:08:13 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:08:15.613682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e034-dfe7-419c-9f6a-9e8fcd2167f1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:15.614247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e034-dfe7-419c-9f6a-9e8fcd2167f1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:15.614247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e034-dfe7-419c-9f6a-9e8fcd2167f1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:15.615469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 742/1479] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:08:15.620879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756611ff-69c6-4556-9b42-fdd534234788 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:15.621285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756611ff-69c6-4556-9b42-fdd534234788 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:15.621465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756611ff-69c6-4556-9b42-fdd534234788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:15.692005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-756611ff-69c6-4556-9b42-fdd534234788 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:08:15.693516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-756611ff-69c6-4556-9b42-fdd534234788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:15.789460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 738/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:08:16.095284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e034-dfe7-419c-9f6a-9e8fcd2167f1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:08:16.096816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6d35e034-dfe7-419c-9f6a-9e8fcd2167f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:16.106646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:16.241294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e034-dfe7-419c-9f6a-9e8fcd2167f1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:08:16.321650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:16.355178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b657d-3665-459c-a8d6-a73030c3510e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:08:16.355815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b657d-3665-459c-a8d6-a73030c3510e service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:16.356094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b657d-3665-459c-a8d6-a73030c3510e service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:16.356366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b657d-3665-459c-a8d6-a73030c3510e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:16.357993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1c0b657d-3665-459c-a8d6-a73030c3510e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:16.564149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b657d-3665-459c-a8d6-a73030c3510e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:08:16.565733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b657d-3665-459c-a8d6-a73030c3510e service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:08:16.583879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 743/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:08:18.880609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11cf5-74dc-4acb-9a99-12861bcaeb97 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:18.881131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11cf5-74dc-4acb-9a99-12861bcaeb97 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:18.881233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c11cf5-74dc-4acb-9a99-12861bcaeb97 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:18.882543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 739/1482] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:08:18.889146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468abaf-82d2-4569-a643-592e1f71a9cb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:18.889679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468abaf-82d2-4569-a643-592e1f71a9cb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:18.889785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468abaf-82d2-4569-a643-592e1f71a9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:18.954221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2468abaf-82d2-4569-a643-592e1f71a9cb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:08:18.955410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2468abaf-82d2-4569-a643-592e1f71a9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:18.999780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:19.049315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 744/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:08:19.339935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c11cf5-74dc-4acb-9a99-12861bcaeb97 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:08:19.341562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-33c11cf5-74dc-4acb-9a99-12861bcaeb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:19.365782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:19.444424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c11cf5-74dc-4acb-9a99-12861bcaeb97 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:08:19.532454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe12bfe-10e8-4f33-a3d6-44a2b0cd0669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:08:19.533064 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe12bfe-10e8-4f33-a3d6-44a2b0cd0669 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:19.533349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe12bfe-10e8-4f33-a3d6-44a2b0cd0669 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:19.533656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe12bfe-10e8-4f33-a3d6-44a2b0cd0669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:19.535251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2fe12bfe-10e8-4f33-a3d6-44a2b0cd0669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:19.610837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:19.646143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe12bfe-10e8-4f33-a3d6-44a2b0cd0669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:08:19.647585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe12bfe-10e8-4f33-a3d6-44a2b0cd0669 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:08:19.666337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 740/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:08:21.869776 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f2b-51d9-4d5f-8501-e459c4850da6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:21.870339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f2b-51d9-4d5f-8501-e459c4850da6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:21.870339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f035f2b-51d9-4d5f-8501-e459c4850da6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:21.871683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 745/1485] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:08:21.877344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bdf11-50e9-49a6-aa0d-c5926c0e5cc1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:21.877825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bdf11-50e9-49a6-aa0d-c5926c0e5cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:21.877929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bdf11-50e9-49a6-aa0d-c5926c0e5cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:21.943061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-242bdf11-50e9-49a6-aa0d-c5926c0e5cc1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:08:21.944259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-242bdf11-50e9-49a6-aa0d-c5926c0e5cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:22.039492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 741/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:08:22.325808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035f2b-51d9-4d5f-8501-e459c4850da6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:08:22.327339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7f035f2b-51d9-4d5f-8501-e459c4850da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:22.429804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f035f2b-51d9-4d5f-8501-e459c4850da6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:08:22.500457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:22.501966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68faaf8-4150-4d9b-bdc0-d98b9ad2ff0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:08:22.502554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68faaf8-4150-4d9b-bdc0-d98b9ad2ff0f service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:22.503067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68faaf8-4150-4d9b-bdc0-d98b9ad2ff0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:22.503526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68faaf8-4150-4d9b-bdc0-d98b9ad2ff0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:22.505356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e68faaf8-4150-4d9b-bdc0-d98b9ad2ff0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:22.613915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68faaf8-4150-4d9b-bdc0-d98b9ad2ff0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:08:22.615270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68faaf8-4150-4d9b-bdc0-d98b9ad2ff0f service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:08:22.633118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 746/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:08:24.923003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5a4f-89ef-4162-b614-dfd78c2afd79 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:24.923538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5a4f-89ef-4162-b614-dfd78c2afd79 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:24.923538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b5a4f-89ef-4162-b614-dfd78c2afd79 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:24.924884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 742/1488] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:08:24.930427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2927-1c93-45b4-a50e-7a783262f26a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:24.930874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2927-1c93-45b4-a50e-7a783262f26a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:24.930972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2927-1c93-45b4-a50e-7a783262f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:24.995520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9c8d2927-1c93-45b4-a50e-7a783262f26a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:08:24.996714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9c8d2927-1c93-45b4-a50e-7a783262f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:25.048835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:25.092441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 747/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:08:25.379881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b5a4f-89ef-4162-b614-dfd78c2afd79 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:08:25.381439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ae3b5a4f-89ef-4162-b614-dfd78c2afd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:25.418397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:25.487290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b5a4f-89ef-4162-b614-dfd78c2afd79 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:08:25.561345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6d37c-66c3-4b50-8703-ccdfc4dcb849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:08:25.562013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6d37c-66c3-4b50-8703-ccdfc4dcb849 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:25.562294 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6d37c-66c3-4b50-8703-ccdfc4dcb849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:25.562562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6d37c-66c3-4b50-8703-ccdfc4dcb849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:25.564144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b8c6d37c-66c3-4b50-8703-ccdfc4dcb849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:25.645279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:25.674844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6d37c-66c3-4b50-8703-ccdfc4dcb849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:08:25.676277 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6d37c-66c3-4b50-8703-ccdfc4dcb849 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:08:25.694393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 743/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:08:28.035273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf4ea4-fcd4-472e-b06b-aea145e0b271 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:28.035811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf4ea4-fcd4-472e-b06b-aea145e0b271 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:28.035811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf4ea4-fcd4-472e-b06b-aea145e0b271 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:28.037187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 748/1491] 10.222.0.20 () {54 vars in 927 bytes} [Thu Sep 8 01:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:08:28.042675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4135-dcf3-4690-85fd-1bcaa9834104 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:28.043105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4135-dcf3-4690-85fd-1bcaa9834104 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:28.043199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4135-dcf3-4690-85fd-1bcaa9834104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:28.108848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6eae4135-dcf3-4690-85fd-1bcaa9834104 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:08:28.110090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6eae4135-dcf3-4690-85fd-1bcaa9834104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:28.206186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 744/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Thu Sep 8 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:08:28.494625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf4ea4-fcd4-472e-b06b-aea145e0b271 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:08:28.496217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e5cf4ea4-fcd4-472e-b06b-aea145e0b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:28.598452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf4ea4-fcd4-472e-b06b-aea145e0b271 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:08:28.670975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fa9fd-50f3-443a-b324-afffb62431dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:08:28.671579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa9fd-50f3-443a-b324-afffb62431dc service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:08:28.671859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa9fd-50f3-443a-b324-afffb62431dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:08:28.672131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fa9fd-50f3-443a-b324-afffb62431dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:08:28.673757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-056fa9fd-50f3-443a-b324-afffb62431dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:08:28.682216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:28.782131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fa9fd-50f3-443a-b324-afffb62431dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:08:28.783494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fa9fd-50f3-443a-b324-afffb62431dc service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:08:28.801377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 749/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:08:38.204622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=82 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:38.799288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=50 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:48.327640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131afec-ac96-41a2-90f7-0a86c84891c8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:48.328253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131afec-ac96-41a2-90f7-0a86c84891c8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:48.328253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131afec-ac96-41a2-90f7-0a86c84891c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:48.404417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3131afec-ac96-41a2-90f7-0a86c84891c8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:09:48.405661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3131afec-ac96-41a2-90f7-0a86c84891c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:48.512701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 745/1494] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:09:48.520631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc196c-a6a4-4547-8a29-e0cb774d963f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:48.521841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc196c-a6a4-4547-8a29-e0cb774d963f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:48.522116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc196c-a6a4-4547-8a29-e0cb774d963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:48.595640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f2bc196c-a6a4-4547-8a29-e0cb774d963f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:09:48.596752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f2bc196c-a6a4-4547-8a29-e0cb774d963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:48.691818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 750/1495] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:09:48.697110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131afec-ac96-41a2-90f7-0a86c84891c8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:48.698464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3131afec-ac96-41a2-90f7-0a86c84891c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:48.709937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131afec-ac96-41a2-90f7-0a86c84891c8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:48.783991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:48.816832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:48.817467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:48.818372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:48.818650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:48.819295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:09:48.819607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:48.820615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:09:48.820615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: warnings.warn(msg) Sep 08 01:09:48.820615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: Sep 08 01:09:48.821530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:48.833588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 746/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:09:48.841992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc196c-a6a4-4547-8a29-e0cb774d963f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:48.851561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc196c-a6a4-4547-8a29-e0cb774d963f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:48.911954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:48.945462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:48.946066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:48.946354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:48.946608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:48.947225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:48.948935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:09:48.948935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Sep 08 01:09:48.948935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: Sep 08 01:09:48.950153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:49.005113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 751/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:09:48 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:09:49.009644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:49.011156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:49.043912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948d778-76b5-41db-bc22-551919972cd1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:49.136354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:49.136944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:49.137217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:49.137511 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:49.138128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:49.139123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:09:49.139123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: warnings.warn(msg) Sep 08 01:09:49.139123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: Sep 08 01:09:49.140318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:49.182103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 747/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:09:49 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:09:49.186282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:49.187826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:49.250453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f96e-07b8-472d-86aa-4e8f2a307527 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:49.334393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:49.345584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:49.346192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:49.346473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:49.346745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:49.347389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:49.348401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:09:49.348401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Sep 08 01:09:49.348401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: Sep 08 01:09:49.349870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:49.361955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 752/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:09:49.366137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:49.367688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:49.379279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8964164-d2f8-49f2-a92a-956420ea1d2f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:49.405961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:49.475423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fac0df-fd51-499a-986e-a9049c4dec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:49.476027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac0df-fd51-499a-986e-a9049c4dec4f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:49.476305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac0df-fd51-499a-986e-a9049c4dec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:49.476577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac0df-fd51-499a-986e-a9049c4dec4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:49.477219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fac0df-fd51-499a-986e-a9049c4dec4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:49.478260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-23fac0df-fd51-499a-986e-a9049c4dec4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:09:49.478260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: warnings.warn(msg) Sep 08 01:09:49.478260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: Sep 08 01:09:49.479157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fac0df-fd51-499a-986e-a9049c4dec4f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:49.491295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 748/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:09:49.495501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:49.497028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:49.531552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2250a66-bdb5-41f3-a835-4f1148aa055d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:49.624830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714c4da-e287-477a-b3b8-37c6368068e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:49.625577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714c4da-e287-477a-b3b8-37c6368068e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:49.625858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714c4da-e287-477a-b3b8-37c6368068e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:49.626130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714c4da-e287-477a-b3b8-37c6368068e9 admin admin] PATH_INFO: `/v3/projects/a057575410264ad4987a737396ef8fa7/users/4f261f86964c4be9b8b1b852ba183740/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:49.648400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714c4da-e287-477a-b3b8-37c6368068e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a057575410264ad4987a737396ef8fa7, user_id=4f261f86964c4be9b8b1b852ba183740, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:49.649456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-d714c4da-e287-477a-b3b8-37c6368068e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:09:49.649456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Sep 08 01:09:49.649456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: Sep 08 01:09:49.651403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714c4da-e287-477a-b3b8-37c6368068e9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:49.676078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 753/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:09:49 2022] PUT /identity/v3/projects/a057575410264ad4987a737396ef8fa7/users/4f261f86964c4be9b8b1b852ba183740/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:09:49.688752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc3d3-c50c-4a74-9186-ca460cda3cf8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:49.689065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc3d3-c50c-4a74-9186-ca460cda3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:49.689337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc3d3-c50c-4a74-9186-ca460cda3cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:49.747344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e94bc3d3-c50c-4a74-9186-ca460cda3cf8 None None] MFA Rules not processed for user `4f261f86964c4be9b8b1b852ba183740`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:09:49.748544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e94bc3d3-c50c-4a74-9186-ca460cda3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:49.824896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 749/1502] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:09:49.838290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e945e-b34b-4c42-90a4-b17e55dfbd81 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:49.838583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e945e-b34b-4c42-90a4-b17e55dfbd81 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:49.838859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e945e-b34b-4c42-90a4-b17e55dfbd81 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:49.840197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 754/1503] 10.222.0.20 () {54 vars in 964 bytes} [Thu Sep 8 01:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:09:49.844831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dd39b-507b-42ac-b189-0b7e646a2d11 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:49.845123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dd39b-507b-42ac-b189-0b7e646a2d11 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:49.845416 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dd39b-507b-42ac-b189-0b7e646a2d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:49.877453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:49.922829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6f0dd39b-507b-42ac-b189-0b7e646a2d11 None None] MFA Rules not processed for user `274ba5fef7d24d97ac97c33a68bb6aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:09:49.924027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6f0dd39b-507b-42ac-b189-0b7e646a2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:49.998193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 750/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Sep 8 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:09:50.008582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e945e-b34b-4c42-90a4-b17e55dfbd81 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:50.010131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bd6e945e-b34b-4c42-90a4-b17e55dfbd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:50.059461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:50.112376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e945e-b34b-4c42-90a4-b17e55dfbd81 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:50.187104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:50.187723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:50.187999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:50.188269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:50.189986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:50.298167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:50.299602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:50.303621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:50.319144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 755/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:09:50.363488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dac83-fd76-4e29-a8d3-2f671b2dee17 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:50.363782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dac83-fd76-4e29-a8d3-2f671b2dee17 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:50.364053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dac83-fd76-4e29-a8d3-2f671b2dee17 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:50.365968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 751/1506] 10.222.0.20 () {52 vars in 830 bytes} [Thu Sep 8 01:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:09:50.369553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:50.370758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:50.467652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca290a-e536-40c0-a2b8-ab3c03b80ac9 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:50.560276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:50.560894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:50.561168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:50.561457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] PATH_INFO: `/v3/users/4f261f86964c4be9b8b1b852ba183740` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:50.573880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f261f86964c4be9b8b1b852ba183740)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:50.574884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:09:50.574884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Sep 08 01:09:50.574884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: Sep 08 01:09:50.576077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:50.585580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:50.641515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f261f86964c4be9b8b1b852ba183740'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:50.650802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f261f86964c4be9b8b1b852ba183740'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:50.674317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f261f86964c4be9b8b1b852ba183740'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:50.674765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f261f86964c4be9b8b1b852ba183740'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:50.689068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f261f86964c4be9b8b1b852ba183740'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:50.694686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 756/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:09:50 2022] DELETE /identity/v3/users/4f261f86964c4be9b8b1b852ba183740 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:09:50.699036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4623c-e737-4766-97b5-0969b57d2630 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:50.699510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4623c-e737-4766-97b5-0969b57d2630 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:50.699610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4623c-e737-4766-97b5-0969b57d2630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:50.756696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-58c4623c-e737-4766-97b5-0969b57d2630 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:09:50.757917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-58c4623c-e737-4766-97b5-0969b57d2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:50.832902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:50.846265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 752/1508] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:09:50.856522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:50.857763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:50.958544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba011815-6510-47ad-afd5-5dc03792f5f3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:51.012093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:09:51.032992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf800d8-f269-4e2b-b648-52e99e7f6444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:51.033622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800d8-f269-4e2b-b648-52e99e7f6444 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:51.033898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800d8-f269-4e2b-b648-52e99e7f6444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:51.034165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800d8-f269-4e2b-b648-52e99e7f6444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:51.035765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-adf800d8-f269-4e2b-b648-52e99e7f6444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:51.146196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf800d8-f269-4e2b-b648-52e99e7f6444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:51.147621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf800d8-f269-4e2b-b648-52e99e7f6444 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:51.166126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 757/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:09:51.516956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4623c-e737-4766-97b5-0969b57d2630 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:09:51.517710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-58c4623c-e737-4766-97b5-0969b57d2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:09:51.530034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4623c-e737-4766-97b5-0969b57d2630 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:09:51.628154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:09:51.628710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:09:51.628988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:09:51.629261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] PATH_INFO: `/v3/projects/a057575410264ad4987a737396ef8fa7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:09:51.639542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a057575410264ad4987a737396ef8fa7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:09:51.640562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:09:51.640562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: warnings.warn(msg) Sep 08 01:09:51.640562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: Sep 08 01:09:51.641873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:09:51.701031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a057575410264ad4987a737396ef8fa7', 'request_id': 'req-3358c205-4432-4f49-aa63-fad33f58ec46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:51.711016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a057575410264ad4987a737396ef8fa7', 'request_id': 'req-3358c205-4432-4f49-aa63-fad33f58ec46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:51.717025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a057575410264ad4987a737396ef8fa7', 'request_id': 'req-3358c205-4432-4f49-aa63-fad33f58ec46'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:51.746914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] The token cache is being invalidate because project a057575410264ad4987a737396ef8fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:09:51.747200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:51.747627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3358c205-4432-4f49-aa63-fad33f58ec46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:09:51.749010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 753/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:09:51 2022] DELETE /identity/v3/projects/a057575410264ad4987a737396ef8fa7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:10:01.163873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=62 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:10:01.744863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:11:23.305971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1dd07-b33c-4bce-8bed-0dff40087711 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:23.306574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1dd07-b33c-4bce-8bed-0dff40087711 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:23.306574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1dd07-b33c-4bce-8bed-0dff40087711 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:23.307950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:23.312798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca8b8-373d-4221-b916-95e3da822eef None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:23.313234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca8b8-373d-4221-b916-95e3da822eef None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:23.313337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca8b8-373d-4221-b916-95e3da822eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:23.394979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0e3ca8b8-373d-4221-b916-95e3da822eef None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:23.396180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0e3ca8b8-373d-4221-b916-95e3da822eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:23.497979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:11:23.652485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1dd07-b33c-4bce-8bed-0dff40087711 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:23.654599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0ce1dd07-b33c-4bce-8bed-0dff40087711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:23.771428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1dd07-b33c-4bce-8bed-0dff40087711 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:23.776883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc43609-db22-4f85-aaac-9c67626268ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:23.777517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc43609-db22-4f85-aaac-9c67626268ee service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:23.777802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc43609-db22-4f85-aaac-9c67626268ee service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:23.778077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc43609-db22-4f85-aaac-9c67626268ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:23.786503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc43609-db22-4f85-aaac-9c67626268ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:23.788085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc43609-db22-4f85-aaac-9c67626268ee service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:23.797302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 759/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:11:24.887470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c527-5dd4-43bb-ac4c-bb14c15bb693 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:24.888013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c527-5dd4-43bb-ac4c-bb14c15bb693 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:24.888124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c527-5dd4-43bb-ac4c-bb14c15bb693 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:24.889423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:24.896117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8193d-427b-4027-8efe-e340945873b6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:24.896550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8193d-427b-4027-8efe-e340945873b6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:24.896687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8193d-427b-4027-8efe-e340945873b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:24.918666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dcf8193d-427b-4027-8efe-e340945873b6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:24.919851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dcf8193d-427b-4027-8efe-e340945873b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:24.927685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:11:25.077826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c527-5dd4-43bb-ac4c-bb14c15bb693 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:25.092388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c527-5dd4-43bb-ac4c-bb14c15bb693 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:25.098480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaab39-a976-45f4-91c6-30d67fb32896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:25.099073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaab39-a976-45f4-91c6-30d67fb32896 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:25.099356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaab39-a976-45f4-91c6-30d67fb32896 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:25.099632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaab39-a976-45f4-91c6-30d67fb32896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:25.107579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaab39-a976-45f4-91c6-30d67fb32896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:25.109157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaab39-a976-45f4-91c6-30d67fb32896 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:25.118452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 756/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:11:25.223938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253b6c6-a74c-4ab1-9360-43e4c77167ea None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:25.224259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253b6c6-a74c-4ab1-9360-43e4c77167ea None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:25.224540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253b6c6-a74c-4ab1-9360-43e4c77167ea None None] PATH_INFO: `/v3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:25.225931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 761/1517] 10.222.0.43 () {54 vars in 925 bytes} [Thu Sep 8 01:11:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:11:25.232249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c709f9-ffeb-4bd8-876a-f4787d855217 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:25.232538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c709f9-ffeb-4bd8-876a-f4787d855217 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:25.232843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c709f9-ffeb-4bd8-876a-f4787d855217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:25.296316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-16c709f9-ffeb-4bd8-876a-f4787d855217 None None] MFA Rules not processed for user `e7e636a8e4704971ae840035f3fc4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:25.297606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-16c709f9-ffeb-4bd8-876a-f4787d855217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:25.314698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:11:25.372735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 757/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 8 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:11:33.994316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f33a0-bbcf-473c-8d80-e72ec728a830 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:33.994859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f33a0-bbcf-473c-8d80-e72ec728a830 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:33.995003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f33a0-bbcf-473c-8d80-e72ec728a830 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:33.996349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 762/1519] 10.222.0.20 () {54 vars in 961 bytes} [Thu Sep 8 01:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:34.001537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64cfaf-9818-4067-831e-aa700d652933 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:34.001991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64cfaf-9818-4067-831e-aa700d652933 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:34.002126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64cfaf-9818-4067-831e-aa700d652933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:34.022683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0a64cfaf-9818-4067-831e-aa700d652933 None None] MFA Rules not processed for user `e7e636a8e4704971ae840035f3fc4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:34.023880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0a64cfaf-9818-4067-831e-aa700d652933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:34.033004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 758/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Sep 8 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:11:34.040470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f33a0-bbcf-473c-8d80-e72ec728a830 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:34.053651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f33a0-bbcf-473c-8d80-e72ec728a830 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:34.058793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa2c6-3f2c-4b6b-bd13-7fee3d8e4961 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:34.059438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa2c6-3f2c-4b6b-bd13-7fee3d8e4961 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:34.059719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa2c6-3f2c-4b6b-bd13-7fee3d8e4961 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:34.059992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa2c6-3f2c-4b6b-bd13-7fee3d8e4961 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:34.068214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfa2c6-3f2c-4b6b-bd13-7fee3d8e4961 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:34.069816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfa2c6-3f2c-4b6b-bd13-7fee3d8e4961 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:34.079660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 763/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:11:36.589628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa4f0-a19f-4743-975c-56c1a1d9d352 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:36.590207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa4f0-a19f-4743-975c-56c1a1d9d352 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:36.590207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa4f0-a19f-4743-975c-56c1a1d9d352 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:36.591494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:36.598066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080401-7752-419f-acc2-8d77c08fa2f5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:36.598503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080401-7752-419f-acc2-8d77c08fa2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:36.598622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080401-7752-419f-acc2-8d77c08fa2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:36.618502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8d080401-7752-419f-acc2-8d77c08fa2f5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:36.619686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8d080401-7752-419f-acc2-8d77c08fa2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:36.627692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:11:36.780520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faa4f0-a19f-4743-975c-56c1a1d9d352 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:36.795080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faa4f0-a19f-4743-975c-56c1a1d9d352 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:36.800920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1350b5-402b-4a9c-a331-9a96af417473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:36.801543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1350b5-402b-4a9c-a331-9a96af417473 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:36.801822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1350b5-402b-4a9c-a331-9a96af417473 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:36.802094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1350b5-402b-4a9c-a331-9a96af417473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:36.809884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1350b5-402b-4a9c-a331-9a96af417473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:36.811444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1350b5-402b-4a9c-a331-9a96af417473 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:36.820590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 760/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:11:37.896283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798ce3-7fff-47ec-8958-8f8c374577a5 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:37.896839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798ce3-7fff-47ec-8958-8f8c374577a5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:37.896839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798ce3-7fff-47ec-8958-8f8c374577a5 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:37.898227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 01:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:37.904588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec8c11-6299-40e1-b870-13e789187a1d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:37.911841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec8c11-6299-40e1-b870-13e789187a1d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:37.911841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec8c11-6299-40e1-b870-13e789187a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:37.927324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1cec8c11-6299-40e1-b870-13e789187a1d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:37.928506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1cec8c11-6299-40e1-b870-13e789187a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:37.936332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:11:38.084813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c798ce3-7fff-47ec-8958-8f8c374577a5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:38.099950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c798ce3-7fff-47ec-8958-8f8c374577a5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:38.105338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc6e6-54a1-433f-a2a2-0054a4b58976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:38.105956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc6e6-54a1-433f-a2a2-0054a4b58976 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:38.106236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc6e6-54a1-433f-a2a2-0054a4b58976 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:38.106507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc6e6-54a1-433f-a2a2-0054a4b58976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:38.115229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cc6e6-54a1-433f-a2a2-0054a4b58976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:38.116806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cc6e6-54a1-433f-a2a2-0054a4b58976 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:38.126142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 766/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:11:42.125435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db997ac-22f4-4e67-90f1-8f48d46086b9 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:42.125965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db997ac-22f4-4e67-90f1-8f48d46086b9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:42.125965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db997ac-22f4-4e67-90f1-8f48d46086b9 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:42.127291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:42.132927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebd26f-8d59-4f3a-9724-14369869230b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:42.133343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebd26f-8d59-4f3a-9724-14369869230b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:42.133525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebd26f-8d59-4f3a-9724-14369869230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:42.153142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2cebd26f-8d59-4f3a-9724-14369869230b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:42.154385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2cebd26f-8d59-4f3a-9724-14369869230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:42.162674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:11:42.455164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db997ac-22f4-4e67-90f1-8f48d46086b9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:42.456861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5db997ac-22f4-4e67-90f1-8f48d46086b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:42.536163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db997ac-22f4-4e67-90f1-8f48d46086b9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:42.539667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a46f-8ac3-4fa2-89a7-e9daef03b45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:42.540301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a46f-8ac3-4fa2-89a7-e9daef03b45f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:42.540574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a46f-8ac3-4fa2-89a7-e9daef03b45f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:42.540843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a46f-8ac3-4fa2-89a7-e9daef03b45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:42.550230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a46f-8ac3-4fa2-89a7-e9daef03b45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:42.551643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a46f-8ac3-4fa2-89a7-e9daef03b45f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:42.560798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 763/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:11:44.686928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0818059-49d0-412f-a425-3a0318809fcc None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:44.687973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0818059-49d0-412f-a425-3a0318809fcc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:44.687973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0818059-49d0-412f-a425-3a0318809fcc None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:44.689355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:44.694771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678d57-765b-4212-8737-dd9c517084c4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:44.695186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678d57-765b-4212-8737-dd9c517084c4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:44.695329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678d57-765b-4212-8737-dd9c517084c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:44.715162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-be678d57-765b-4212-8737-dd9c517084c4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:44.716366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-be678d57-765b-4212-8737-dd9c517084c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:44.724206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:11:45.012392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0818059-49d0-412f-a425-3a0318809fcc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:45.023432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0818059-49d0-412f-a425-3a0318809fcc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:45.026953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d76b73-84b7-420f-b079-ce66db4aa21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:45.027539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d76b73-84b7-420f-b079-ce66db4aa21d service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:45.027813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d76b73-84b7-420f-b079-ce66db4aa21d service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:45.028081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d76b73-84b7-420f-b079-ce66db4aa21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:45.037352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d76b73-84b7-420f-b079-ce66db4aa21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:45.038790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d76b73-84b7-420f-b079-ce66db4aa21d service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:45.048555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 769/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:11:48.634362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df416-0315-41c0-be6c-0242ddac992f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:48.634953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df416-0315-41c0-be6c-0242ddac992f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:48.634953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df416-0315-41c0-be6c-0242ddac992f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:48.636257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:48.641685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f153bcb-27b2-451c-9ff2-7143b68a9a22 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:48.642159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f153bcb-27b2-451c-9ff2-7143b68a9a22 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:48.642263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f153bcb-27b2-451c-9ff2-7143b68a9a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:48.661766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3f153bcb-27b2-451c-9ff2-7143b68a9a22 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:48.662943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3f153bcb-27b2-451c-9ff2-7143b68a9a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:48.670505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:11:48.974239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df416-0315-41c0-be6c-0242ddac992f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:48.975920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7a6df416-0315-41c0-be6c-0242ddac992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:49.040803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:11:49.054243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df416-0315-41c0-be6c-0242ddac992f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:49.057817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb83db-cb73-4d79-acac-61e85f22aec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:49.058418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb83db-cb73-4d79-acac-61e85f22aec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:49.058700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb83db-cb73-4d79-acac-61e85f22aec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:49.058972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb83db-cb73-4d79-acac-61e85f22aec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:49.067772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb83db-cb73-4d79-acac-61e85f22aec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:49.069202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb83db-cb73-4d79-acac-61e85f22aec4 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:49.079079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 766/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:11:51.229226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99cf7-27c6-4099-b5b7-5b289336119c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:51.229822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99cf7-27c6-4099-b5b7-5b289336119c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:51.229822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99cf7-27c6-4099-b5b7-5b289336119c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:51.231163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 01:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:11:51.239264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac033d-aa44-441b-a1ec-0d4d82a3a36e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:51.239677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac033d-aa44-441b-a1ec-0d4d82a3a36e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:51.239818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac033d-aa44-441b-a1ec-0d4d82a3a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:51.260683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0eac033d-aa44-441b-a1ec-0d4d82a3a36e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:11:51.261920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0eac033d-aa44-441b-a1ec-0d4d82a3a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:51.271070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:11:51.578425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab99cf7-27c6-4099-b5b7-5b289336119c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:11:51.580101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2ab99cf7-27c6-4099-b5b7-5b289336119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:11:51.587679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:11:51.594208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab99cf7-27c6-4099-b5b7-5b289336119c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:11:51.597802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52c01a-fb5d-4c04-b60f-7b1a3efd4b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:11:51.598404 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c01a-fb5d-4c04-b60f-7b1a3efd4b34 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:11:51.598683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c01a-fb5d-4c04-b60f-7b1a3efd4b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:11:51.598955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c01a-fb5d-4c04-b60f-7b1a3efd4b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:11:51.608091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52c01a-fb5d-4c04-b60f-7b1a3efd4b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:11:51.609578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52c01a-fb5d-4c04-b60f-7b1a3efd4b34 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:11:51.619156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 772/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:12:01.255370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=11 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:12:01.614810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:17.075989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625957-282e-497d-ae26-19d7ab2852c6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.076629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625957-282e-497d-ae26-19d7ab2852c6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.076629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625957-282e-497d-ae26-19d7ab2852c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.107771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-00625957-282e-497d-ae26-19d7ab2852c6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.109019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-00625957-282e-497d-ae26-19d7ab2852c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.118132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 768/1540] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:13:17.127384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4204ed-0402-4571-9e2a-f6a5dbbc4121 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.128447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4204ed-0402-4571-9e2a-f6a5dbbc4121 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.128973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4204ed-0402-4571-9e2a-f6a5dbbc4121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.162409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5a4204ed-0402-4571-9e2a-f6a5dbbc4121 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.164111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5a4204ed-0402-4571-9e2a-f6a5dbbc4121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.176310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 773/1541] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.181602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625957-282e-497d-ae26-19d7ab2852c6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:17.196908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625957-282e-497d-ae26-19d7ab2852c6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:17.204970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:17.205986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.206517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.206984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.207948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:17.208713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:17.210777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:17.226177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 769/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:17.235121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4204ed-0402-4571-9e2a-f6a5dbbc4121 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:17.248862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4204ed-0402-4571-9e2a-f6a5dbbc4121 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:17.257835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbf3e2-610f-4827-8988-8a276ddf6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:17.258656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf3e2-610f-4827-8988-8a276ddf6cdd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.259046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf3e2-610f-4827-8988-8a276ddf6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.259428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf3e2-610f-4827-8988-8a276ddf6cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.260190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbf3e2-610f-4827-8988-8a276ddf6cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:17.262263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbf3e2-610f-4827-8988-8a276ddf6cdd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:17.326541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 774/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:17.331298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:17.346506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952aae60-a023-4086-b095-2da244cae398 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:17.434313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934afae1-3f61-4120-91bf-8b2482eecf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:17.435333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934afae1-3f61-4120-91bf-8b2482eecf82 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.435829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934afae1-3f61-4120-91bf-8b2482eecf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.436308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934afae1-3f61-4120-91bf-8b2482eecf82 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.437231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934afae1-3f61-4120-91bf-8b2482eecf82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:17.439480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934afae1-3f61-4120-91bf-8b2482eecf82 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:17.472925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 770/1544] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:17.477849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbf3e2-610f-4827-8988-8a276ddf6cdd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:17.498324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbf3e2-610f-4827-8988-8a276ddf6cdd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:17.508985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49023e5a-13b9-40ad-bf45-85bbccc08cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:17.509798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49023e5a-13b9-40ad-bf45-85bbccc08cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.509980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49023e5a-13b9-40ad-bf45-85bbccc08cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.510212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49023e5a-13b9-40ad-bf45-85bbccc08cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.510871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49023e5a-13b9-40ad-bf45-85bbccc08cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:17.513012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49023e5a-13b9-40ad-bf45-85bbccc08cbe admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:17.528628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 775/1545] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:17.532780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934afae1-3f61-4120-91bf-8b2482eecf82 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:17.550751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934afae1-3f61-4120-91bf-8b2482eecf82 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:17.562314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa7dcc-d21b-410f-8692-d85cf1059d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:17.563246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7dcc-d21b-410f-8692-d85cf1059d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.563722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7dcc-d21b-410f-8692-d85cf1059d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.564243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7dcc-d21b-410f-8692-d85cf1059d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.565109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa7dcc-d21b-410f-8692-d85cf1059d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:17.566965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa7dcc-d21b-410f-8692-d85cf1059d29 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:17.572970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389258ed-7033-4eae-9637-76cac7c69bcb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.573255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389258ed-7033-4eae-9637-76cac7c69bcb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.573588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389258ed-7033-4eae-9637-76cac7c69bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.584356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 771/1546] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:17.594170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a2dc-3db7-4b98-8cc9-d59aa90d24de None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.594762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a2dc-3db7-4b98-8cc9-d59aa90d24de None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.595249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a2dc-3db7-4b98-8cc9-d59aa90d24de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.611462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-389258ed-7033-4eae-9637-76cac7c69bcb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.614090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-389258ed-7033-4eae-9637-76cac7c69bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.635338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2c44a2dc-3db7-4b98-8cc9-d59aa90d24de None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.636992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 776/1547] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.638656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389258ed-7033-4eae-9637-76cac7c69bcb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:17.644941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2c44a2dc-3db7-4b98-8cc9-d59aa90d24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.655685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389258ed-7033-4eae-9637-76cac7c69bcb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:17.659289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 772/1548] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:13:17.662955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2755-5bc7-46c2-801e-0135c5908b7f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.662955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2755-5bc7-46c2-801e-0135c5908b7f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.662955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2755-5bc7-46c2-801e-0135c5908b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.664086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc3354-7f62-481d-8cd1-6f6ea6576584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:17.666092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3354-7f62-481d-8cd1-6f6ea6576584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.666092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3354-7f62-481d-8cd1-6f6ea6576584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.666092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3354-7f62-481d-8cd1-6f6ea6576584 admin admin] PATH_INFO: `/v3/projects/e8c1bd67ce014e3ca985da76a9a99eec/users/02ea86be2fb345de863968fca03fa350/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.686291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc3354-7f62-481d-8cd1-6f6ea6576584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c1bd67ce014e3ca985da76a9a99eec, user_id=02ea86be2fb345de863968fca03fa350, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:17.689152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc3354-7f62-481d-8cd1-6f6ea6576584 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:17.689976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-02dc2755-5bc7-46c2-801e-0135c5908b7f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.691172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-02dc2755-5bc7-46c2-801e-0135c5908b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.700479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 773/1549] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.701753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773ea5-ad2b-4977-ae8b-4000469d5f31 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.702035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773ea5-ad2b-4977-ae8b-4000469d5f31 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.702315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773ea5-ad2b-4977-ae8b-4000469d5f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.706943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 777/1550] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:17 2022] PUT /identity/v3/projects/e8c1bd67ce014e3ca985da76a9a99eec/users/02ea86be2fb345de863968fca03fa350/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:17.713902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5f0e5-ba6b-4dcc-a65c-486c878b8dcf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.714202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5f0e5-ba6b-4dcc-a65c-486c878b8dcf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.714471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5f0e5-ba6b-4dcc-a65c-486c878b8dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.723963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ef773ea5-ad2b-4977-ae8b-4000469d5f31 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.725202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ef773ea5-ad2b-4977-ae8b-4000469d5f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.738338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-eec5f0e5-ba6b-4dcc-a65c-486c878b8dcf None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.739532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eec5f0e5-ba6b-4dcc-a65c-486c878b8dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.786997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 774/1551] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.788488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227352-a034-4342-b5df-f1abcaff48a8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.788772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227352-a034-4342-b5df-f1abcaff48a8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.789047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227352-a034-4342-b5df-f1abcaff48a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.801294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 778/1552] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.802582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d17f-633e-4b60-b935-185381a01916 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.802865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d17f-633e-4b60-b935-185381a01916 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.803139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818d17f-633e-4b60-b935-185381a01916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.811965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4e227352-a034-4342-b5df-f1abcaff48a8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.813174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4e227352-a034-4342-b5df-f1abcaff48a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.821179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 775/1553] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.822425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5f94-c3ad-49e5-a41b-6e9071ada1e2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.822705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5f94-c3ad-49e5-a41b-6e9071ada1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.822975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5f94-c3ad-49e5-a41b-6e9071ada1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.823123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7818d17f-633e-4b60-b935-185381a01916 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.824384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7818d17f-633e-4b60-b935-185381a01916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.833902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 779/1554] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.835374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849589-475f-475b-b755-d5958e189d47 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.835610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849589-475f-475b-b755-d5958e189d47 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.835892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2849589-475f-475b-b755-d5958e189d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.842558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-145f5f94-c3ad-49e5-a41b-6e9071ada1e2 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.843735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-145f5f94-c3ad-49e5-a41b-6e9071ada1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.851715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 776/1555] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.852789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba130c1-4c47-475d-9557-2bcfbd4a7ae1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.853073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba130c1-4c47-475d-9557-2bcfbd4a7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.853345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba130c1-4c47-475d-9557-2bcfbd4a7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.856313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f2849589-475f-475b-b755-d5958e189d47 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.857752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f2849589-475f-475b-b755-d5958e189d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.865860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 780/1556] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.867078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4858a-d191-48c3-8f00-949ffb0d79c8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.867363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4858a-d191-48c3-8f00-949ffb0d79c8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.867641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4858a-d191-48c3-8f00-949ffb0d79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.884719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0ba130c1-4c47-475d-9557-2bcfbd4a7ae1 None None] MFA Rules not processed for user `02ea86be2fb345de863968fca03fa350`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.885961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0ba130c1-4c47-475d-9557-2bcfbd4a7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.887995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6da4858a-d191-48c3-8f00-949ffb0d79c8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.889200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6da4858a-d191-48c3-8f00-949ffb0d79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.897212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 781/1557] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.898032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4858a-d191-48c3-8f00-949ffb0d79c8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:17.911605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4858a-d191-48c3-8f00-949ffb0d79c8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:17.912250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:17.916367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6240e-f420-4c40-9aab-0cbf6625d46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:17.916974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6240e-f420-4c40-9aab-0cbf6625d46d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.917255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6240e-f420-4c40-9aab-0cbf6625d46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.917552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6240e-f420-4c40-9aab-0cbf6625d46d admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.918203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6240e-f420-4c40-9aab-0cbf6625d46d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:17.918511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6240e-f420-4c40-9aab-0cbf6625d46d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:17.919588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-6ea6240e-f420-4c40-9aab-0cbf6625d46d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:13:17.919588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Sep 08 01:13:17.919588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: Sep 08 01:13:17.920498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6240e-f420-4c40-9aab-0cbf6625d46d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:17.939803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 782/1558] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:17.939803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d40-7489-4813-888e-277320436188 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.939803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d40-7489-4813-888e-277320436188 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.939803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d40-7489-4813-888e-277320436188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.953715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-52974d40-7489-4813-888e-277320436188 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.954919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-52974d40-7489-4813-888e-277320436188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.959154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 777/1559] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.960436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f698f-92bb-43e0-a5e8-4fe4edb221be None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.960763 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f698f-92bb-43e0-a5e8-4fe4edb221be None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.960993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f698f-92bb-43e0-a5e8-4fe4edb221be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.963495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 783/1560] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.964215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974d40-7489-4813-888e-277320436188 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:17.974108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974d40-7489-4813-888e-277320436188 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:17.978675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:17.979261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.979539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.979932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.980570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:17.980668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0a2f698f-92bb-43e0-a5e8-4fe4edb221be None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:17.980878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:17.981938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0a2f698f-92bb-43e0-a5e8-4fe4edb221be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:17.982632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:17.989982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 778/1561] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:17.991159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5e3bb-2bab-4e34-8477-922da148fa14 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:17.991446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5e3bb-2bab-4e34-8477-922da148fa14 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:17.991724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5e3bb-2bab-4e34-8477-922da148fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:17.997814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 784/1562] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:17.998512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.008903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af7fd4-614e-4286-9315-bee19825ff69 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.011728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a9e5e3bb-2bab-4e34-8477-922da148fa14 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:18.013051 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a9e5e3bb-2bab-4e34-8477-922da148fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:18.013626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.014212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.014493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.014763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.015520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:18.015825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.017434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.021099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 779/1563] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:18.021099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89bab-cbbd-4d7a-9b78-33668018e1f6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.021099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89bab-cbbd-4d7a-9b78-33668018e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.021099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89bab-cbbd-4d7a-9b78-33668018e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.030700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 785/1564] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:18.031484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.040930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99d80-7f74-45c9-b81f-861af2a2678a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.046226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad2a7d-4be0-43d3-a096-73e49bc290ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.046889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2a7d-4be0-43d3-a096-73e49bc290ad admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.047236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2a7d-4be0-43d3-a096-73e49bc290ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.047574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2a7d-4be0-43d3-a096-73e49bc290ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.048254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad2a7d-4be0-43d3-a096-73e49bc290ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.049587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8bf89bab-cbbd-4d7a-9b78-33668018e1f6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:18.050230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad2a7d-4be0-43d3-a096-73e49bc290ad admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.050777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8bf89bab-cbbd-4d7a-9b78-33668018e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:18.058670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 780/1565] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:18.062440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf89bab-cbbd-4d7a-9b78-33668018e1f6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.067621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:18.068555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf89bab-cbbd-4d7a-9b78-33668018e1f6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.075403 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.076136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.076737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.076737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.077383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.078426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:13:18.078426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: warnings.warn(msg) Sep 08 01:13:18.078426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: Sep 08 01:13:18.079624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.086456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 786/1566] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.086456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad2a7d-4be0-43d3-a096-73e49bc290ad admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.107135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 781/1567] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.108032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.153398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad2a7d-4be0-43d3-a096-73e49bc290ad admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.171472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f500-1433-45a8-8d37-8f42f3d6b660 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.175955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.176579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.176861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.177141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.177808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:18.178114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.179709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.191469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 782/1568] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:18.192462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.204248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5fce1-4a3c-4217-bb5f-3323d5dc3ad3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.209126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2571-a243-40c6-8441-f5ec5a0fa1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.209746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2571-a243-40c6-8441-f5ec5a0fa1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.210020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2571-a243-40c6-8441-f5ec5a0fa1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.210291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc2571-a243-40c6-8441-f5ec5a0fa1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.210913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc2571-a243-40c6-8441-f5ec5a0fa1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.211190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.211951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.212317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.212682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.212835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc2571-a243-40c6-8441-f5ec5a0fa1e8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.213535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:18.213931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.216141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.227863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 787/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:18.228949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.239873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fe1f8-fc59-4015-8f39-1ea63f8c4b71 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.241665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 783/1570] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.242520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2571-a243-40c6-8441-f5ec5a0fa1e8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.294756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:18.300564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.301261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.301632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.301974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.302809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:18.303207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.304954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.306359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc2571-a243-40c6-8441-f5ec5a0fa1e8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.311987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48572c-9f21-4deb-ba06-10411877bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.312590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48572c-9f21-4deb-ba06-10411877bc92 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.312862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48572c-9f21-4deb-ba06-10411877bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.313131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48572c-9f21-4deb-ba06-10411877bc92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.313911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48572c-9f21-4deb-ba06-10411877bc92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.315790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48572c-9f21-4deb-ba06-10411877bc92 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.317033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 788/1571] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:18.322267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.331974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b5945-350d-4a5f-808b-cf4e4e265491 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.337589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.338155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.338434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.338706 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.339374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:18.339663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.341278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.343927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 784/1572] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.344297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48572c-9f21-4deb-ba06-10411877bc92 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.361297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 789/1573] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:18.361297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.366634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c3d92-65ce-44b3-a48a-ce791c318118 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.378932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:18.412484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48572c-9f21-4deb-ba06-10411877bc92 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.417520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732def3f-a220-4440-be57-ac6014d16fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.418136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732def3f-a220-4440-be57-ac6014d16fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.418421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732def3f-a220-4440-be57-ac6014d16fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.418729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732def3f-a220-4440-be57-ac6014d16fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.419377 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732def3f-a220-4440-be57-ac6014d16fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.421301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732def3f-a220-4440-be57-ac6014d16fb3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.425728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.426320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.426595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.426861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.427476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.428515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:13:18.428515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Sep 08 01:13:18.428515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: Sep 08 01:13:18.429730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.445641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 785/1574] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.446302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732def3f-a220-4440-be57-ac6014d16fb3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.454665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 790/1575] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.454665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.459011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732def3f-a220-4440-be57-ac6014d16fb3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.462119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05594f32-e4f5-4a4f-ab83-01d9e72231d3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.463850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5e3bd-1f7f-47ff-af40-8a4a6f47ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.464480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e3bd-1f7f-47ff-af40-8a4a6f47ed70 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.464785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e3bd-1f7f-47ff-af40-8a4a6f47ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.465058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e3bd-1f7f-47ff-af40-8a4a6f47ed70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.466248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5e3bd-1f7f-47ff-af40-8a4a6f47ed70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.467458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0585-84ae-45bf-851b-a8b778ac46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.468043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0585-84ae-45bf-851b-a8b778ac46b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.468181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5e3bd-1f7f-47ff-af40-8a4a6f47ed70 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.468322 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0585-84ae-45bf-851b-a8b778ac46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.468596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d0585-84ae-45bf-851b-a8b778ac46b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.469215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d0585-84ae-45bf-851b-a8b778ac46b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.471144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d0585-84ae-45bf-851b-a8b778ac46b9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.496009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 786/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.497736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5e3bd-1f7f-47ff-af40-8a4a6f47ed70 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.500926 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 791/1577] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.501680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0585-84ae-45bf-851b-a8b778ac46b9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.566807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5e3bd-1f7f-47ff-af40-8a4a6f47ed70 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.567262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d0585-84ae-45bf-851b-a8b778ac46b9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.571433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2697b-52c9-4a1d-8510-1f8597edbf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.571811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd8e87-ebb6-4425-843a-59d9ba4f2723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.572037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2697b-52c9-4a1d-8510-1f8597edbf2f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.572320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2697b-52c9-4a1d-8510-1f8597edbf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.572443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8e87-ebb6-4425-843a-59d9ba4f2723 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.572593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2697b-52c9-4a1d-8510-1f8597edbf2f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.572696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8e87-ebb6-4425-843a-59d9ba4f2723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.572938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8e87-ebb6-4425-843a-59d9ba4f2723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.573230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2697b-52c9-4a1d-8510-1f8597edbf2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.573598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd8e87-ebb6-4425-843a-59d9ba4f2723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.575240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2697b-52c9-4a1d-8510-1f8597edbf2f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.575694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd8e87-ebb6-4425-843a-59d9ba4f2723 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.599026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 787/1578] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.599751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2697b-52c9-4a1d-8510-1f8597edbf2f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.603343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 792/1579] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.604180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd8e87-ebb6-4425-843a-59d9ba4f2723 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.610485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2697b-52c9-4a1d-8510-1f8597edbf2f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.642710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:18.667022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd8e87-ebb6-4425-843a-59d9ba4f2723 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.668430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1d247-3610-49bf-aafa-11b1b7bfc9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.669148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1d247-3610-49bf-aafa-11b1b7bfc9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.669453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1d247-3610-49bf-aafa-11b1b7bfc9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.669731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1d247-3610-49bf-aafa-11b1b7bfc9ca admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.670363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1d247-3610-49bf-aafa-11b1b7bfc9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.671823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a990-a238-4f18-9654-e6430cd6721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.672270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1d247-3610-49bf-aafa-11b1b7bfc9ca admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.672420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a990-a238-4f18-9654-e6430cd6721e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.672701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a990-a238-4f18-9654-e6430cd6721e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.672975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a990-a238-4f18-9654-e6430cd6721e admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.673658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5a990-a238-4f18-9654-e6430cd6721e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.675581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5a990-a238-4f18-9654-e6430cd6721e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.691276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:18.695841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 788/1580] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.696735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1d247-3610-49bf-aafa-11b1b7bfc9ca admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.707313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1d247-3610-49bf-aafa-11b1b7bfc9ca admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.709140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 793/1581] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.709999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a990-a238-4f18-9654-e6430cd6721e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.765174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460f977-4943-4fce-91bb-3c85784c0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.765850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f977-4943-4fce-91bb-3c85784c0207 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.766130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f977-4943-4fce-91bb-3c85784c0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.766405 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f977-4943-4fce-91bb-3c85784c0207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.767221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460f977-4943-4fce-91bb-3c85784c0207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.769382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460f977-4943-4fce-91bb-3c85784c0207 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.771238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a990-a238-4f18-9654-e6430cd6721e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.775793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eada37-71f8-48be-a67b-aea19657300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.776381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eada37-71f8-48be-a67b-aea19657300c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.776659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eada37-71f8-48be-a67b-aea19657300c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.776926 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eada37-71f8-48be-a67b-aea19657300c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.777585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eada37-71f8-48be-a67b-aea19657300c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.779630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 789/1582] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:18.780413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460f977-4943-4fce-91bb-3c85784c0207 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.781461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eada37-71f8-48be-a67b-aea19657300c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.789863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460f977-4943-4fce-91bb-3c85784c0207 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.795256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 794/1583] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:18.795256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eada37-71f8-48be-a67b-aea19657300c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.798257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193177e4-1eac-42c5-a22f-a1537c44717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.798875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193177e4-1eac-42c5-a22f-a1537c44717f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.799151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193177e4-1eac-42c5-a22f-a1537c44717f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.799426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193177e4-1eac-42c5-a22f-a1537c44717f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.800067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193177e4-1eac-42c5-a22f-a1537c44717f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.802015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193177e4-1eac-42c5-a22f-a1537c44717f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.803048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eada37-71f8-48be-a67b-aea19657300c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.808261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1dd39-22ee-4eee-a783-30ac0a3c1e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.808847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1dd39-22ee-4eee-a783-30ac0a3c1e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.809122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1dd39-22ee-4eee-a783-30ac0a3c1e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.809438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1dd39-22ee-4eee-a783-30ac0a3c1e0b admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.810191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1dd39-22ee-4eee-a783-30ac0a3c1e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.812007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1dd39-22ee-4eee-a783-30ac0a3c1e0b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.830104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 790/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/users => generated 294 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.830104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193177e4-1eac-42c5-a22f-a1537c44717f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.836332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 795/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.837119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1dd39-22ee-4eee-a783-30ac0a3c1e0b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.843936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193177e4-1eac-42c5-a22f-a1537c44717f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.847309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1dd39-22ee-4eee-a783-30ac0a3c1e0b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.848907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c0f7f-51a9-4778-b09a-b702364ef26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.849673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0f7f-51a9-4778-b09a-b702364ef26b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.849887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0f7f-51a9-4778-b09a-b702364ef26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.850164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0f7f-51a9-4778-b09a-b702364ef26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.850851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c0f7f-51a9-4778-b09a-b702364ef26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.852051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb67c46-e1d8-4063-a2d0-0501bb566789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.852451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c0f7f-51a9-4778-b09a-b702364ef26b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.852718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67c46-e1d8-4063-a2d0-0501bb566789 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.853003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67c46-e1d8-4063-a2d0-0501bb566789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.853274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67c46-e1d8-4063-a2d0-0501bb566789 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.853919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb67c46-e1d8-4063-a2d0-0501bb566789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.855806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb67c46-e1d8-4063-a2d0-0501bb566789 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.863268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 791/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:18.863878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c0f7f-51a9-4778-b09a-b702364ef26b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.873891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c0f7f-51a9-4778-b09a-b702364ef26b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.878754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce63ccb-1356-4151-b78d-d38b81c7e565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.879343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce63ccb-1356-4151-b78d-d38b81c7e565 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.879881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce63ccb-1356-4151-b78d-d38b81c7e565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.880160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce63ccb-1356-4151-b78d-d38b81c7e565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.880786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce63ccb-1356-4151-b78d-d38b81c7e565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.880991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 796/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.881821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb67c46-e1d8-4063-a2d0-0501bb566789 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.882416 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce63ccb-1356-4151-b78d-d38b81c7e565 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.891883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb67c46-e1d8-4063-a2d0-0501bb566789 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.896548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 792/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:18.896548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce63ccb-1356-4151-b78d-d38b81c7e565 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.898488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf898cf-c8da-42c6-a281-8be82a802c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.899069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf898cf-c8da-42c6-a281-8be82a802c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.899345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf898cf-c8da-42c6-a281-8be82a802c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.899611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf898cf-c8da-42c6-a281-8be82a802c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.900229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf898cf-c8da-42c6-a281-8be82a802c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.902193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf898cf-c8da-42c6-a281-8be82a802c05 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.906629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce63ccb-1356-4151-b78d-d38b81c7e565 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.912302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576cca-cff5-4d28-8c21-49e587235b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.912921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576cca-cff5-4d28-8c21-49e587235b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.913205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576cca-cff5-4d28-8c21-49e587235b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.913505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576cca-cff5-4d28-8c21-49e587235b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.914257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e576cca-cff5-4d28-8c21-49e587235b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.916218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e576cca-cff5-4d28-8c21-49e587235b25 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.923643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 797/1589] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:18 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:18.924528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf898cf-c8da-42c6-a281-8be82a802c05 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.929322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 793/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:18.929322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576cca-cff5-4d28-8c21-49e587235b25 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.936282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf898cf-c8da-42c6-a281-8be82a802c05 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.936631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576cca-cff5-4d28-8c21-49e587235b25 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.940761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10493456-b5f4-4862-ac3a-827ac22424b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.941164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79ba6b-7584-4c84-a84a-1a392b48059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.941393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493456-b5f4-4862-ac3a-827ac22424b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.941771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ba6b-7584-4c84-a84a-1a392b48059f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.942059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ba6b-7584-4c84-a84a-1a392b48059f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.942312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493456-b5f4-4862-ac3a-827ac22424b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.942425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ba6b-7584-4c84-a84a-1a392b48059f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.942591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493456-b5f4-4862-ac3a-827ac22424b9 admin admin] PATH_INFO: `/v3/projects/dd927f302e0b48eca1f5bbaea194207b/users/1893befe74e4405bb09917694305f2a1/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.942942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79ba6b-7584-4c84-a84a-1a392b48059f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.944517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79ba6b-7584-4c84-a84a-1a392b48059f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.955170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 794/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:18.955957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79ba6b-7584-4c84-a84a-1a392b48059f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.960089 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10493456-b5f4-4862-ac3a-827ac22424b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd927f302e0b48eca1f5bbaea194207b, user_id=1893befe74e4405bb09917694305f2a1, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.962870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10493456-b5f4-4862-ac3a-827ac22424b9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.965135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79ba6b-7584-4c84-a84a-1a392b48059f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:18.970249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1268ee7-aa31-4d9b-a15e-7eea0d0cbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:18.970918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1268ee7-aa31-4d9b-a15e-7eea0d0cbb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:18.971255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1268ee7-aa31-4d9b-a15e-7eea0d0cbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:18.971546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1268ee7-aa31-4d9b-a15e-7eea0d0cbb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:18.972169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1268ee7-aa31-4d9b-a15e-7eea0d0cbb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:18.973771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1268ee7-aa31-4d9b-a15e-7eea0d0cbb3e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:18.976703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 798/1592] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:18 2022] PUT /identity/v3/projects/dd927f302e0b48eca1f5bbaea194207b/users/1893befe74e4405bb09917694305f2a1/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:18.977535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10493456-b5f4-4862-ac3a-827ac22424b9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.988060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 795/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:18.988060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1268ee7-aa31-4d9b-a15e-7eea0d0cbb3e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:18.998007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1268ee7-aa31-4d9b-a15e-7eea0d0cbb3e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.042479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:19.043188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10493456-b5f4-4862-ac3a-827ac22424b9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.049233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904725c0-59cd-4859-b270-b2c4862df4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.049870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904725c0-59cd-4859-b270-b2c4862df4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.050145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904725c0-59cd-4859-b270-b2c4862df4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.050412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904725c0-59cd-4859-b270-b2c4862df4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.051050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904725c0-59cd-4859-b270-b2c4862df4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.052625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904725c0-59cd-4859-b270-b2c4862df4e8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.056342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e16f8-4543-49c8-8ec4-ba3cc8f1b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.056970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e16f8-4543-49c8-8ec4-ba3cc8f1b5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.057248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e16f8-4543-49c8-8ec4-ba3cc8f1b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.057566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e16f8-4543-49c8-8ec4-ba3cc8f1b5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.058203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e16f8-4543-49c8-8ec4-ba3cc8f1b5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.059899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e16f8-4543-49c8-8ec4-ba3cc8f1b5fb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.062789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 799/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.063598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904725c0-59cd-4859-b270-b2c4862df4e8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.070949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 796/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.071727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e16f8-4543-49c8-8ec4-ba3cc8f1b5fb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.073596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904725c0-59cd-4859-b270-b2c4862df4e8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.078789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abc015-ada2-41bc-bc87-16d61c0376e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.079376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc015-ada2-41bc-bc87-16d61c0376e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.079653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc015-ada2-41bc-bc87-16d61c0376e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.079926 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc015-ada2-41bc-bc87-16d61c0376e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.080696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abc015-ada2-41bc-bc87-16d61c0376e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.081573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e16f8-4543-49c8-8ec4-ba3cc8f1b5fb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.082338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abc015-ada2-41bc-bc87-16d61c0376e8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.084441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:19.086492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.087238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.087615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.087993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] PATH_INFO: `/v3/projects/5247b740ac8c4a04808432284961f40c/users/e67e4e9e8c2c41c68dd7dd92a3297e93/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.094197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 800/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.095234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abc015-ada2-41bc-bc87-16d61c0376e8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.104120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5247b740ac8c4a04808432284961f40c, user_id=e67e4e9e8c2c41c68dd7dd92a3297e93, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.104722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abc015-ada2-41bc-bc87-16d61c0376e8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.105244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:13:19.105244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: warnings.warn(msg) Sep 08 01:13:19.105244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: Sep 08 01:13:19.108012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.109997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb71bc8-d578-438d-9cae-8bcda7d1aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.110568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb71bc8-d578-438d-9cae-8bcda7d1aa1e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.110845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb71bc8-d578-438d-9cae-8bcda7d1aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.111137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb71bc8-d578-438d-9cae-8bcda7d1aa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.111739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb71bc8-d578-438d-9cae-8bcda7d1aa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.113569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb71bc8-d578-438d-9cae-8bcda7d1aa1e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.121986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 797/1597] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:19 2022] PUT /identity/v3/projects/5247b740ac8c4a04808432284961f40c/users/e67e4e9e8c2c41c68dd7dd92a3297e93/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:19.122792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.125103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 801/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.126470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb71bc8-d578-438d-9cae-8bcda7d1aa1e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.136956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb71bc8-d578-438d-9cae-8bcda7d1aa1e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.186218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f52924-7a04-4e39-b99a-869f94c93309 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.191073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff6de-2b74-4319-8e9b-d4c174590fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.191669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff6de-2b74-4319-8e9b-d4c174590fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.191947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff6de-2b74-4319-8e9b-d4c174590fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.192354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff6de-2b74-4319-8e9b-d4c174590fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.192989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff6de-2b74-4319-8e9b-d4c174590fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.193192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc40dd0-b584-4c49-a70a-cd39dc393202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.193855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc40dd0-b584-4c49-a70a-cd39dc393202 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.194133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc40dd0-b584-4c49-a70a-cd39dc393202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.194579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc40dd0-b584-4c49-a70a-cd39dc393202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.194683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff6de-2b74-4319-8e9b-d4c174590fa9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.195284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc40dd0-b584-4c49-a70a-cd39dc393202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.196985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc40dd0-b584-4c49-a70a-cd39dc393202 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.204677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 798/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.205496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff6de-2b74-4319-8e9b-d4c174590fa9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.210080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 802/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.210080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc40dd0-b584-4c49-a70a-cd39dc393202 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.215273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff6de-2b74-4319-8e9b-d4c174590fa9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.218171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc40dd0-b584-4c49-a70a-cd39dc393202 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.220602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91970af5-7689-4201-b38c-644621220494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.221228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91970af5-7689-4201-b38c-644621220494 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.221545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91970af5-7689-4201-b38c-644621220494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.221825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91970af5-7689-4201-b38c-644621220494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.222510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91970af5-7689-4201-b38c-644621220494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.222735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318517-5bc5-4feb-a035-34e4cc9963a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.223360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318517-5bc5-4feb-a035-34e4cc9963a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.223639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318517-5bc5-4feb-a035-34e4cc9963a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.223911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318517-5bc5-4feb-a035-34e4cc9963a8 admin admin] PATH_INFO: `/v3/projects/2423dbb8cf0c49328f18a267a043d8d1/users/82c57dc9d6ec4bc78631bea0bef77410/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.224150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91970af5-7689-4201-b38c-644621220494 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.238123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 799/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.238882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed318517-5bc5-4feb-a035-34e4cc9963a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2423dbb8cf0c49328f18a267a043d8d1, user_id=82c57dc9d6ec4bc78631bea0bef77410, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.239012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91970af5-7689-4201-b38c-644621220494 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.241915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed318517-5bc5-4feb-a035-34e4cc9963a8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.249166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91970af5-7689-4201-b38c-644621220494 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.255889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 803/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:19 2022] PUT /identity/v3/projects/2423dbb8cf0c49328f18a267a043d8d1/users/82c57dc9d6ec4bc78631bea0bef77410/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:19.256652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318517-5bc5-4feb-a035-34e4cc9963a8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.316055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed00ebd-3291-4637-83b3-da757dbb0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.316851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00ebd-3291-4637-83b3-da757dbb0bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.317234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00ebd-3291-4637-83b3-da757dbb0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.317373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318517-5bc5-4feb-a035-34e4cc9963a8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.317728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00ebd-3291-4637-83b3-da757dbb0bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.318467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed00ebd-3291-4637-83b3-da757dbb0bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.320166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed00ebd-3291-4637-83b3-da757dbb0bd8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.322009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ac734-3b84-4b09-a69a-d52a01a91f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.322657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac734-3b84-4b09-a69a-d52a01a91f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.322934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac734-3b84-4b09-a69a-d52a01a91f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.323215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac734-3b84-4b09-a69a-d52a01a91f53 admin admin] PATH_INFO: `/v3/projects/4994044e8688482195339ae8037ec215/users/9684fc6cb8364623b9c418ab316dafeb/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.330287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 800/1603] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.331483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf9be6-0a94-4439-bfa8-c7ae47eca901 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.331769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf9be6-0a94-4439-bfa8-c7ae47eca901 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.332045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf9be6-0a94-4439-bfa8-c7ae47eca901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.341230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ac734-3b84-4b09-a69a-d52a01a91f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4994044e8688482195339ae8037ec215, user_id=9684fc6cb8364623b9c418ab316dafeb, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.344136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ac734-3b84-4b09-a69a-d52a01a91f53 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.350921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bdbf9be6-0a94-4439-bfa8-c7ae47eca901 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:19.352375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bdbf9be6-0a94-4439-bfa8-c7ae47eca901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:19.357731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 804/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:19 2022] PUT /identity/v3/projects/4994044e8688482195339ae8037ec215/users/9684fc6cb8364623b9c418ab316dafeb/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:19.358474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ac734-3b84-4b09-a69a-d52a01a91f53 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.393828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:19.404170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:19.416556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 801/1605] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:19.420651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf9be6-0a94-4439-bfa8-c7ae47eca901 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.423585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ac734-3b84-4b09-a69a-d52a01a91f53 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.428555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97971181-6bca-4b39-96b5-856d5f37aa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.429165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971181-6bca-4b39-96b5-856d5f37aa2f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.429482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971181-6bca-4b39-96b5-856d5f37aa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.429763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971181-6bca-4b39-96b5-856d5f37aa2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.429954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf9be6-0a94-4439-bfa8-c7ae47eca901 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.430407 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97971181-6bca-4b39-96b5-856d5f37aa2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.432006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97971181-6bca-4b39-96b5-856d5f37aa2f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.435520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a75f64-1899-455b-aa94-577424a92e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.436269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75f64-1899-455b-aa94-577424a92e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.436645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75f64-1899-455b-aa94-577424a92e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.437037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75f64-1899-455b-aa94-577424a92e21 admin admin] PATH_INFO: `/v3/projects/91d70034e6ca4457b458ac51eba10005/users/b657cf5dbf394b9db923082f00565a3a/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.445786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 805/1606] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:19.445786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97971181-6bca-4b39-96b5-856d5f37aa2f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.451732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a75f64-1899-455b-aa94-577424a92e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d70034e6ca4457b458ac51eba10005, user_id=b657cf5dbf394b9db923082f00565a3a, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.454413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a75f64-1899-455b-aa94-577424a92e21 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.455223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97971181-6bca-4b39-96b5-856d5f37aa2f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.459833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfee14-3989-46de-8e98-8723475abb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.460471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfee14-3989-46de-8e98-8723475abb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.460750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfee14-3989-46de-8e98-8723475abb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.461023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfee14-3989-46de-8e98-8723475abb39 admin admin] PATH_INFO: `/v3/projects/dd927f302e0b48eca1f5bbaea194207b/users/1893befe74e4405bb09917694305f2a1/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.462941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfee14-3989-46de-8e98-8723475abb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd927f302e0b48eca1f5bbaea194207b, user_id=1893befe74e4405bb09917694305f2a1, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.466126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfee14-3989-46de-8e98-8723475abb39 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.467631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 802/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:19 2022] PUT /identity/v3/projects/91d70034e6ca4457b458ac51eba10005/users/b657cf5dbf394b9db923082f00565a3a/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:19.468399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a75f64-1899-455b-aa94-577424a92e21 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.476840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 806/1608] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:19 2022] PUT /identity/v3/projects/dd927f302e0b48eca1f5bbaea194207b/users/1893befe74e4405bb09917694305f2a1/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:19.478066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f543a-c866-4e68-b411-812da976da5e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.478345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f543a-c866-4e68-b411-812da976da5e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.478613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f543a-c866-4e68-b411-812da976da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.511080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-322f543a-c866-4e68-b411-812da976da5e None None] MFA Rules not processed for user `82c57dc9d6ec4bc78631bea0bef77410`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:19.512322 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-322f543a-c866-4e68-b411-812da976da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:19.540259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a75f64-1899-455b-aa94-577424a92e21 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.578851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 807/1609] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:19.579726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f543a-c866-4e68-b411-812da976da5e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.604303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186df40b-f33e-4601-b804-81496b494c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.604989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186df40b-f33e-4601-b804-81496b494c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.605254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186df40b-f33e-4601-b804-81496b494c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.605563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186df40b-f33e-4601-b804-81496b494c78 admin admin] PATH_INFO: `/v3/projects/8228644f631f4536b94c127cde97628c/users/971c3d6ed522423892bdcaced4815388/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.624177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186df40b-f33e-4601-b804-81496b494c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8228644f631f4536b94c127cde97628c, user_id=971c3d6ed522423892bdcaced4815388, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.627163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186df40b-f33e-4601-b804-81496b494c78 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.643559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 803/1610] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:19 2022] PUT /identity/v3/projects/8228644f631f4536b94c127cde97628c/users/971c3d6ed522423892bdcaced4815388/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:19.644946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ffd6-12bb-47f9-816a-1df56709e46c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.645230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ffd6-12bb-47f9-816a-1df56709e46c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.645544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ffd6-12bb-47f9-816a-1df56709e46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.649254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f543a-c866-4e68-b411-812da976da5e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.664408 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-13d6ffd6-12bb-47f9-816a-1df56709e46c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:19.665629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-13d6ffd6-12bb-47f9-816a-1df56709e46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:19.711133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0cafa-e527-4882-b8fa-631db1ba3d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.711798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0cafa-e527-4882-b8fa-631db1ba3d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.712074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0cafa-e527-4882-b8fa-631db1ba3d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.712344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0cafa-e527-4882-b8fa-631db1ba3d37 admin admin] PATH_INFO: `/v3/projects/889f6b4456c44a868fe8a44cd60c6808/users/5cea7737368147a78c91fd4b89139ff6/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.713229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:19.715925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:19.728592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0cafa-e527-4882-b8fa-631db1ba3d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889f6b4456c44a868fe8a44cd60c6808, user_id=5cea7737368147a78c91fd4b89139ff6, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.732054 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0cafa-e527-4882-b8fa-631db1ba3d37 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.735310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 804/1611] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:19.735310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6ffd6-12bb-47f9-816a-1df56709e46c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.749885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 808/1612] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:19 2022] PUT /identity/v3/projects/889f6b4456c44a868fe8a44cd60c6808/users/5cea7737368147a78c91fd4b89139ff6/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:19.749885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0cafa-e527-4882-b8fa-631db1ba3d37 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:19.795738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6ffd6-12bb-47f9-816a-1df56709e46c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.809918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0cafa-e527-4882-b8fa-631db1ba3d37 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:19.814522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0e560-d474-41d4-9077-8ce206675399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.815169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e560-d474-41d4-9077-8ce206675399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.815445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e560-d474-41d4-9077-8ce206675399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.815719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e560-d474-41d4-9077-8ce206675399 admin admin] PATH_INFO: `/v3/projects/0c852563d28d4ba7a1a5f86f6b3f7dd5/users/768145b7184e4380a22ae5df2aba17d0/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.830961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0e560-d474-41d4-9077-8ce206675399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c852563d28d4ba7a1a5f86f6b3f7dd5, user_id=768145b7184e4380a22ae5df2aba17d0, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.833637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0e560-d474-41d4-9077-8ce206675399 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.846485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe5db9-884d-4d0f-a70f-9bc2ccd3a2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:19.857242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5db9-884d-4d0f-a70f-9bc2ccd3a2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.857438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 809/1613] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:19 2022] PUT /identity/v3/projects/0c852563d28d4ba7a1a5f86f6b3f7dd5/users/768145b7184e4380a22ae5df2aba17d0/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:19.857546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5db9-884d-4d0f-a70f-9bc2ccd3a2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.857546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5db9-884d-4d0f-a70f-9bc2ccd3a2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.857714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207ecc-8398-4f9f-b450-554b19c5c70e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.857714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207ecc-8398-4f9f-b450-554b19c5c70e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.857714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207ecc-8398-4f9f-b450-554b19c5c70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.865549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe5db9-884d-4d0f-a70f-9bc2ccd3a2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:19.866989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe5db9-884d-4d0f-a70f-9bc2ccd3a2a0 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:19.874430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e0207ecc-8398-4f9f-b450-554b19c5c70e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:19.875577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e0207ecc-8398-4f9f-b450-554b19c5c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:19.876702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 805/1614] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:19.877944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f6326-9764-4294-a8ef-a528481087d9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.878233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f6326-9764-4294-a8ef-a528481087d9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.878501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f6326-9764-4294-a8ef-a528481087d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.908739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-834f6326-9764-4294-a8ef-a528481087d9 None None] MFA Rules not processed for user `1893befe74e4405bb09917694305f2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:19.910030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-834f6326-9764-4294-a8ef-a528481087d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:19.947509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 810/1615] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:19.949081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935ec06-0455-4f00-9581-78a53dac1b57 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.949574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935ec06-0455-4f00-9581-78a53dac1b57 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.950646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935ec06-0455-4f00-9581-78a53dac1b57 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.952370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 811/1616] 10.222.0.20 () {54 vars in 962 bytes} [Thu Sep 8 01:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:13:19.953570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf74822-c8fa-4ec4-a378-4719f901e9a3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:19.953849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf74822-c8fa-4ec4-a378-4719f901e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:19.954245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf74822-c8fa-4ec4-a378-4719f901e9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:19.984115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 806/1617] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:19.986529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-eaf74822-c8fa-4ec4-a378-4719f901e9a3 None None] MFA Rules not processed for user `971c3d6ed522423892bdcaced4815388`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:19.987972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eaf74822-c8fa-4ec4-a378-4719f901e9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:19.988856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f6326-9764-4294-a8ef-a528481087d9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.034161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:20.056772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:20.061632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f6326-9764-4294-a8ef-a528481087d9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.064117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 812/1618] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:20.065178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ddb2-5e3b-4d9c-8060-f6694e1ea3d7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.065571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ddb2-5e3b-4d9c-8060-f6694e1ea3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.065922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20ddb2-5e3b-4d9c-8060-f6694e1ea3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.069489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a5b7-1b4a-4967-b13a-89f54c980da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.070218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a5b7-1b4a-4967-b13a-89f54c980da3 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.070576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a5b7-1b4a-4967-b13a-89f54c980da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.070926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a5b7-1b4a-4967-b13a-89f54c980da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.083729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a5b7-1b4a-4967-b13a-89f54c980da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.085571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a5b7-1b4a-4967-b13a-89f54c980da3 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.102212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 807/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:20.103338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cbbbb-dccf-474b-bcee-f68149b965c3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.104678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ae20ddb2-5e3b-4d9c-8060-f6694e1ea3d7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:20.105483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cbbbb-dccf-474b-bcee-f68149b965c3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.105926 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ae20ddb2-5e3b-4d9c-8060-f6694e1ea3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:20.107725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cbbbb-dccf-474b-bcee-f68149b965c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.118071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 813/1620] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:20.118071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20ddb2-5e3b-4d9c-8060-f6694e1ea3d7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.118378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ae20ddb2-5e3b-4d9c-8060-f6694e1ea3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:20.131759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20ddb2-5e3b-4d9c-8060-f6694e1ea3d7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.137439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214be1b-3404-4f24-a89c-eabc7cd97a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.137818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214be1b-3404-4f24-a89c-eabc7cd97a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.138191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214be1b-3404-4f24-a89c-eabc7cd97a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.138424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214be1b-3404-4f24-a89c-eabc7cd97a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.141653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-388cbbbb-dccf-474b-bcee-f68149b965c3 None None] MFA Rules not processed for user `768145b7184e4380a22ae5df2aba17d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:20.142879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-388cbbbb-dccf-474b-bcee-f68149b965c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:20.149763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214be1b-3404-4f24-a89c-eabc7cd97a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.151202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214be1b-3404-4f24-a89c-eabc7cd97a5b service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.169803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 814/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:20.171472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b624da-cdff-4630-bce5-c4ebb3d3035b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.171764 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b624da-cdff-4630-bce5-c4ebb3d3035b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.172172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b624da-cdff-4630-bce5-c4ebb3d3035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.219531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e2b624da-cdff-4630-bce5-c4ebb3d3035b None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:20.220747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e2b624da-cdff-4630-bce5-c4ebb3d3035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:20.225052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 808/1622] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:20.227435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cbbbb-dccf-474b-bcee-f68149b965c3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.308902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cbbbb-dccf-474b-bcee-f68149b965c3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.313453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1675621-fc54-42b0-b86a-5b47ead28be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.314244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675621-fc54-42b0-b86a-5b47ead28be8 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.314654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675621-fc54-42b0-b86a-5b47ead28be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.315077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675621-fc54-42b0-b86a-5b47ead28be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.323661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 815/1623] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Sep 8 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:20.325918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681540-8c88-4313-83a5-d780b177881b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.326257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681540-8c88-4313-83a5-d780b177881b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.326536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681540-8c88-4313-83a5-d780b177881b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.327591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1675621-fc54-42b0-b86a-5b47ead28be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.328632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 816/1624] 10.222.0.20 () {54 vars in 962 bytes} [Thu Sep 8 01:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:13:20.329367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681540-8c88-4313-83a5-d780b177881b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.330368 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1675621-fc54-42b0-b86a-5b47ead28be8 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.344089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 809/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:20.345579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1675621-fc54-42b0-b86a-5b47ead28be8 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.345893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681540-8c88-4313-83a5-d780b177881b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.351732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff3d26-8134-4554-bfb7-93c2d5718958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.352431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff3d26-8134-4554-bfb7-93c2d5718958 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.352753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff3d26-8134-4554-bfb7-93c2d5718958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.353099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff3d26-8134-4554-bfb7-93c2d5718958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.358319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1675621-fc54-42b0-b86a-5b47ead28be8 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.364582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934e9f8-6793-40c7-9e57-981d68dbf16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.365746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934e9f8-6793-40c7-9e57-981d68dbf16f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.366250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934e9f8-6793-40c7-9e57-981d68dbf16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.366763 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934e9f8-6793-40c7-9e57-981d68dbf16f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.367626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934e9f8-6793-40c7-9e57-981d68dbf16f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.368824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff3d26-8134-4554-bfb7-93c2d5718958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.370420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934e9f8-6793-40c7-9e57-981d68dbf16f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.371148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff3d26-8134-4554-bfb7-93c2d5718958 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.389705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 817/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:20.390626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff3d26-8134-4554-bfb7-93c2d5718958 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.406905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff3d26-8134-4554-bfb7-93c2d5718958 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.414141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 810/1627] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:20 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:20.415737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb14d-71be-43cf-94b9-8a12c5f38c3e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.416325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb14d-71be-43cf-94b9-8a12c5f38c3e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.416775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb14d-71be-43cf-94b9-8a12c5f38c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.424748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e4aad-868b-4f52-a60f-3860a6fa5e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.425477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e4aad-868b-4f52-a60f-3860a6fa5e84 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.425758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e4aad-868b-4f52-a60f-3860a6fa5e84 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.426170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e4aad-868b-4f52-a60f-3860a6fa5e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.465182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b58fb14d-71be-43cf-94b9-8a12c5f38c3e None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:20.466600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b58fb14d-71be-43cf-94b9-8a12c5f38c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:20.536654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:20.553044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e4aad-868b-4f52-a60f-3860a6fa5e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.554844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e4aad-868b-4f52-a60f-3860a6fa5e84 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.566204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 818/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:20.566869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e4aad-868b-4f52-a60f-3860a6fa5e84 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.583958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 811/1629] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Sep 8 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:20.593265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e4aad-868b-4f52-a60f-3860a6fa5e84 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.595839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fb14d-71be-43cf-94b9-8a12c5f38c3e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.640172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fb14d-71be-43cf-94b9-8a12c5f38c3e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.663373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a7e0e-48f1-471d-943c-47e7434b3b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.664011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a7e0e-48f1-471d-943c-47e7434b3b82 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.664289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a7e0e-48f1-471d-943c-47e7434b3b82 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.664558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a7e0e-48f1-471d-943c-47e7434b3b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.677454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:20.714478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1e42e-f6c5-444e-8f8e-7c9b01c387da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.716084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1e42e-f6c5-444e-8f8e-7c9b01c387da admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.716084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1e42e-f6c5-444e-8f8e-7c9b01c387da admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.716319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1e42e-f6c5-444e-8f8e-7c9b01c387da admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.717199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1e42e-f6c5-444e-8f8e-7c9b01c387da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.719453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1e42e-f6c5-444e-8f8e-7c9b01c387da admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.751233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a7e0e-48f1-471d-943c-47e7434b3b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.753660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a7e0e-48f1-471d-943c-47e7434b3b82 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.771787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 812/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:13:20.780988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 819/1631] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:20 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:20.782704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a7e0e-48f1-471d-943c-47e7434b3b82 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.800775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a7e0e-48f1-471d-943c-47e7434b3b82 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.814452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71cc9-87fd-4293-972a-ac681ae07c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.815354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71cc9-87fd-4293-972a-ac681ae07c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.815776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71cc9-87fd-4293-972a-ac681ae07c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.818420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71cc9-87fd-4293-972a-ac681ae07c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.819155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf71cc9-87fd-4293-972a-ac681ae07c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.820969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf71cc9-87fd-4293-972a-ac681ae07c00 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.851797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 813/1632] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:13:20.856317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1e42e-f6c5-444e-8f8e-7c9b01c387da admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.867819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1e42e-f6c5-444e-8f8e-7c9b01c387da admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:20.879331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e50ce9-e236-474b-b83f-0534d694e928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:20.881058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50ce9-e236-474b-b83f-0534d694e928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:20.881338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50ce9-e236-474b-b83f-0534d694e928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:20.882833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50ce9-e236-474b-b83f-0534d694e928 admin admin] PATH_INFO: `/v3/projects/c712b860941d49b0bc90469c00f74ea6/users/e1f97ae2cc09445ba6aa4decff23cada/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:20.931788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e50ce9-e236-474b-b83f-0534d694e928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c712b860941d49b0bc90469c00f74ea6, user_id=e1f97ae2cc09445ba6aa4decff23cada, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:20.938098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e50ce9-e236-474b-b83f-0534d694e928 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:20.965046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 820/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:20 2022] PUT /identity/v3/projects/c712b860941d49b0bc90469c00f74ea6/users/e1f97ae2cc09445ba6aa4decff23cada/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:20.969880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71cc9-87fd-4293-972a-ac681ae07c00 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:20.985594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71cc9-87fd-4293-972a-ac681ae07c00 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:21.001962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b6011-3690-4f8c-8a98-d0402f453608 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.002237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b6011-3690-4f8c-8a98-d0402f453608 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.002513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b6011-3690-4f8c-8a98-d0402f453608 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.004388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 821/1634] 10.222.0.20 () {54 vars in 912 bytes} [Thu Sep 8 01:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:13:21.017687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8e9a-b430-47c1-a366-d3c55e6639c7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.017983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8e9a-b430-47c1-a366-d3c55e6639c7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.018255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8e9a-b430-47c1-a366-d3c55e6639c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.073805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a7ee8e9a-b430-47c1-a366-d3c55e6639c7 None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:21.075573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a7ee8e9a-b430-47c1-a366-d3c55e6639c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:21.174707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a493-1f0a-405d-9f85-f73227efa7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:21.175332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a493-1f0a-405d-9f85-f73227efa7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.175609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a493-1f0a-405d-9f85-f73227efa7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.175881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a493-1f0a-405d-9f85-f73227efa7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.176531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2a493-1f0a-405d-9f85-f73227efa7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:21.178181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2a493-1f0a-405d-9f85-f73227efa7d5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:21.218975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 814/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:21.230792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a493-1f0a-405d-9f85-f73227efa7d5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:21.256419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a493-1f0a-405d-9f85-f73227efa7d5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:21.284962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca604-d83a-4e78-b0f3-416da9877516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:21.285804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca604-d83a-4e78-b0f3-416da9877516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.286185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca604-d83a-4e78-b0f3-416da9877516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.286551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca604-d83a-4e78-b0f3-416da9877516 admin admin] PATH_INFO: `/v3/projects/c712b860941d49b0bc90469c00f74ea6/users/e1f97ae2cc09445ba6aa4decff23cada/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.295343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca604-d83a-4e78-b0f3-416da9877516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c712b860941d49b0bc90469c00f74ea6, user_id=e1f97ae2cc09445ba6aa4decff23cada, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:21.301022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 822/1636] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:21.302550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca604-d83a-4e78-b0f3-416da9877516 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:21.310111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8e9a-b430-47c1-a366-d3c55e6639c7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:21.331892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 815/1637] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:21 2022] PUT /identity/v3/projects/c712b860941d49b0bc90469c00f74ea6/users/e1f97ae2cc09445ba6aa4decff23cada/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:21.342082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113ba7-0a06-4598-8759-6995c110c2a9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.342452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113ba7-0a06-4598-8759-6995c110c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.342732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113ba7-0a06-4598-8759-6995c110c2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.442653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8e9a-b430-47c1-a366-d3c55e6639c7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:21.481852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4d113ba7-0a06-4598-8759-6995c110c2a9 None None] MFA Rules not processed for user `e1f97ae2cc09445ba6aa4decff23cada`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:21.486067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4d113ba7-0a06-4598-8759-6995c110c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:21.507668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84a2c-7792-46de-8c8b-83c096a91c3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:21.507668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84a2c-7792-46de-8c8b-83c096a91c3f service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.507668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84a2c-7792-46de-8c8b-83c096a91c3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.507668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84a2c-7792-46de-8c8b-83c096a91c3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.520866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:21.583480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:21.623727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 816/1638] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:21.626903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ec92-5bb6-46dc-aaec-1a9fbd2378b9 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.627414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ec92-5bb6-46dc-aaec-1a9fbd2378b9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.628369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ec92-5bb6-46dc-aaec-1a9fbd2378b9 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.631216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 817/1639] 10.222.0.20 () {54 vars in 912 bytes} [Thu Sep 8 01:13:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:13:21.642043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d7427-e749-4eaa-a1a8-8caa944f24d2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.642365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d7427-e749-4eaa-a1a8-8caa944f24d2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.642631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d7427-e749-4eaa-a1a8-8caa944f24d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.661802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a84a2c-7792-46de-8c8b-83c096a91c3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:21.661802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a84a2c-7792-46de-8c8b-83c096a91c3f service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:21.678663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 823/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:13:21.679560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84a2c-7792-46de-8c8b-83c096a91c3f service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:21.688731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a16d7427-e749-4eaa-a1a8-8caa944f24d2 None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:21.690341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a16d7427-e749-4eaa-a1a8-8caa944f24d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:21.692886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84a2c-7792-46de-8c8b-83c096a91c3f service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:21.700483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83415d30-d0de-48e4-8b3d-603b2e02021b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:21.701104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415d30-d0de-48e4-8b3d-603b2e02021b service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.701386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415d30-d0de-48e4-8b3d-603b2e02021b service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.702077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83415d30-d0de-48e4-8b3d-603b2e02021b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.721663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 818/1641] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:21.726150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83415d30-d0de-48e4-8b3d-603b2e02021b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:21.727803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83415d30-d0de-48e4-8b3d-603b2e02021b service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:21.751314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 824/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:21.819246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d7427-e749-4eaa-a1a8-8caa944f24d2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:21.829566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d7427-e749-4eaa-a1a8-8caa944f24d2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:21.835117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c33a3-86d1-4ebe-a6d6-af307f29907d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:21.835861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c33a3-86d1-4ebe-a6d6-af307f29907d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:21.836219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c33a3-86d1-4ebe-a6d6-af307f29907d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:21.836939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c33a3-86d1-4ebe-a6d6-af307f29907d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:21.848983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c33a3-86d1-4ebe-a6d6-af307f29907d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:21.850568 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c33a3-86d1-4ebe-a6d6-af307f29907d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:21.863389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 819/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:22.100090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83415d30-d0de-48e4-8b3d-603b2e02021b service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:22.134638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83415d30-d0de-48e4-8b3d-603b2e02021b service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:22.142733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85070df-fcfb-4e8c-b76f-406cd0f91e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:22.143698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85070df-fcfb-4e8c-b76f-406cd0f91e7a service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:22.144188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85070df-fcfb-4e8c-b76f-406cd0f91e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:22.144707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85070df-fcfb-4e8c-b76f-406cd0f91e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:22.278583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85070df-fcfb-4e8c-b76f-406cd0f91e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:22.281573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85070df-fcfb-4e8c-b76f-406cd0f91e7a service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:22.331130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 825/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:22.442913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c33a3-86d1-4ebe-a6d6-af307f29907d service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:22.609225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c33a3-86d1-4ebe-a6d6-af307f29907d service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:22.625446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:22.626120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:22.626941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:22.627232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] PATH_INFO: `/v3/users/971c3d6ed522423892bdcaced4815388` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:22.628613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971c3d6ed522423892bdcaced4815388)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:22.632351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: WARNING py.warnings [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:13:22.632351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: warnings.warn(msg) Sep 08 01:13:22.632351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: Sep 08 01:13:22.635083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:22.826544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971c3d6ed522423892bdcaced4815388'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:22.884625 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971c3d6ed522423892bdcaced4815388'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:22.939997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971c3d6ed522423892bdcaced4815388'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:22.944809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971c3d6ed522423892bdcaced4815388'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:22.974212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971c3d6ed522423892bdcaced4815388'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:22.995066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 820/1645] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:22 2022] DELETE /identity/v3/users/971c3d6ed522423892bdcaced4815388 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:22.998163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecce4e-9e30-48f4-a464-10272b4cf0d5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:22.998469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecce4e-9e30-48f4-a464-10272b4cf0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:22.998751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecce4e-9e30-48f4-a464-10272b4cf0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:23.038207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fdecce4e-9e30-48f4-a464-10272b4cf0d5 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:23.039402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fdecce4e-9e30-48f4-a464-10272b4cf0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:23.133096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 826/1646] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:23.174425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:23.176461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:23.267643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:23.328499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa004-8669-4020-87ab-731b53115c26 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:23.338287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba44ca-7bb2-4bcb-b197-128050382dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:23.339397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba44ca-7bb2-4bcb-b197-128050382dea service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:23.339397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba44ca-7bb2-4bcb-b197-128050382dea service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:23.339647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba44ca-7bb2-4bcb-b197-128050382dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:23.362346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba44ca-7bb2-4bcb-b197-128050382dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:23.366854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba44ca-7bb2-4bcb-b197-128050382dea service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:23.395998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 821/1647] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:24.531782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecce4e-9e30-48f4-a464-10272b4cf0d5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:24.533362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fdecce4e-9e30-48f4-a464-10272b4cf0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:24.553956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecce4e-9e30-48f4-a464-10272b4cf0d5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:24.567222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:24.568043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:24.569392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:24.569729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] PATH_INFO: `/v3/users/02ea86be2fb345de863968fca03fa350` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:24.573264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ea86be2fb345de863968fca03fa350)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:24.575867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:24.620466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:24.693222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ea86be2fb345de863968fca03fa350'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:24.717678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ea86be2fb345de863968fca03fa350'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:24.733975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ea86be2fb345de863968fca03fa350'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:24.734728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ea86be2fb345de863968fca03fa350'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:24.743396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ea86be2fb345de863968fca03fa350'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:24.752299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 827/1648] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:24 2022] DELETE /identity/v3/users/02ea86be2fb345de863968fca03fa350 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:24.757737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a3af-acc4-4f54-8800-cae7a2b2d058 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:24.758245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a3af-acc4-4f54-8800-cae7a2b2d058 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:24.758462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a3af-acc4-4f54-8800-cae7a2b2d058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:24.818545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3c90a3af-acc4-4f54-8800-cae7a2b2d058 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:24.825981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3c90a3af-acc4-4f54-8800-cae7a2b2d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:25.012652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 822/1649] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:25.016118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:25.019701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:25.036847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01e1f7-b434-45f3-b579-c6db169c7c2a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:25.039029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a3af-acc4-4f54-8800-cae7a2b2d058 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:25.040803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3c90a3af-acc4-4f54-8800-cae7a2b2d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:25.060617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:25.064904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:25.077566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:25.078101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] PATH_INFO: `/v3/projects/8228644f631f4536b94c127cde97628c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:25.083133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8228644f631f4536b94c127cde97628c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:25.087375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 01:13:25.087375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Sep 08 01:13:25.087375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: Sep 08 01:13:25.088997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:25.204424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a3af-acc4-4f54-8800-cae7a2b2d058 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:25.231659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8228644f631f4536b94c127cde97628c', 'request_id': 'req-8b978998-97d4-4ee1-84ec-15448c7f9111'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:25.248453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8228644f631f4536b94c127cde97628c', 'request_id': 'req-8b978998-97d4-4ee1-84ec-15448c7f9111'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:25.284659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8228644f631f4536b94c127cde97628c', 'request_id': 'req-8b978998-97d4-4ee1-84ec-15448c7f9111'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:25.310433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] The token cache is being invalidate because project 8228644f631f4536b94c127cde97628c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:25.310661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:25.312714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8b978998-97d4-4ee1-84ec-15448c7f9111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:25.316900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 828/1650] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:25 2022] DELETE /identity/v3/projects/8228644f631f4536b94c127cde97628c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:25.320704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06821352-f8cf-47b1-9318-7a5edcce86cf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:25.320978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06821352-f8cf-47b1-9318-7a5edcce86cf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:25.321255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06821352-f8cf-47b1-9318-7a5edcce86cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:25.339488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:25.342553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:25.342835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:25.344071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:25.349476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:25.366633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-06821352-f8cf-47b1-9318-7a5edcce86cf None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:25.368067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-06821352-f8cf-47b1-9318-7a5edcce86cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:25.501525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:25.521299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 829/1651] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:13:25.532943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678af88b-b4b3-497a-adf5-8b2b1621fd64 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:25.536015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678af88b-b4b3-497a-adf5-8b2b1621fd64 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:25.538050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678af88b-b4b3-497a-adf5-8b2b1621fd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:25.550351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:25.551984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:25.564894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 823/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:25.585602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-678af88b-b4b3-497a-adf5-8b2b1621fd64 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:25.587359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-678af88b-b4b3-497a-adf5-8b2b1621fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:25.607774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 830/1653] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:25.612193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:25.628108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925be2b-8972-4a59-8f95-7709113afa24 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:25.637752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:25.638384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:25.638668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:25.638944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:25.639610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:25.639910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:25.641911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:25.669238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 824/1654] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:25.670852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678af88b-b4b3-497a-adf5-8b2b1621fd64 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:25.682385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678af88b-b4b3-497a-adf5-8b2b1621fd64 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:25.696343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4edcef-3f80-429d-b240-5c571abb8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:25.697208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4edcef-3f80-429d-b240-5c571abb8415 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:25.697542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4edcef-3f80-429d-b240-5c571abb8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:25.697791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4edcef-3f80-429d-b240-5c571abb8415 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:25.698512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4edcef-3f80-429d-b240-5c571abb8415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:25.702107 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4edcef-3f80-429d-b240-5c571abb8415 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:25.737563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:25.805979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 831/1655] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:25 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:13:25.811083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:25.845943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8b4b0-3d11-4d82-90e3-858c00fc2b72 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:26.026775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9a34a-7908-45e7-8d97-ddb7f66ecd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:26.028192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9a34a-7908-45e7-8d97-ddb7f66ecd79 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:26.029963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9a34a-7908-45e7-8d97-ddb7f66ecd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:26.030385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9a34a-7908-45e7-8d97-ddb7f66ecd79 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:26.031527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9a34a-7908-45e7-8d97-ddb7f66ecd79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:26.035471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9a34a-7908-45e7-8d97-ddb7f66ecd79 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:26.080694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 825/1656] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:25 2022] POST /identity/v3/users => generated 282 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:26.084503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4edcef-3f80-429d-b240-5c571abb8415 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:26.112738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4edcef-3f80-429d-b240-5c571abb8415 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:26.143718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a3aa4-0763-440f-9a85-1f1d7364db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:26.144543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a3aa4-0763-440f-9a85-1f1d7364db32 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:26.144929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a3aa4-0763-440f-9a85-1f1d7364db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:26.145497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a3aa4-0763-440f-9a85-1f1d7364db32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:26.150059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a3aa4-0763-440f-9a85-1f1d7364db32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:26.157599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a3aa4-0763-440f-9a85-1f1d7364db32 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:26.205358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 832/1657] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:26.209935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9a34a-7908-45e7-8d97-ddb7f66ecd79 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:26.230529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9a34a-7908-45e7-8d97-ddb7f66ecd79 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:26.248282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69b79-8d62-4efc-afe9-862acbd46dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:26.248987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69b79-8d62-4efc-afe9-862acbd46dce admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:26.249305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69b79-8d62-4efc-afe9-862acbd46dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:26.249687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69b79-8d62-4efc-afe9-862acbd46dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:26.250522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b69b79-8d62-4efc-afe9-862acbd46dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:26.252297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b69b79-8d62-4efc-afe9-862acbd46dce admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:26.285659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a3aa4-0763-440f-9a85-1f1d7364db32 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:26.295102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 826/1658] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:26.304050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a3aa4-0763-440f-9a85-1f1d7364db32 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:26.325258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20462d-02fb-4a0a-a793-0469cc2b23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:26.325258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20462d-02fb-4a0a-a793-0469cc2b23f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:26.325258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20462d-02fb-4a0a-a793-0469cc2b23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:26.325258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20462d-02fb-4a0a-a793-0469cc2b23f2 admin admin] PATH_INFO: `/v3/projects/e52a750568fc447e829e22e724219a6b/users/d4b1ab8e50754ca28e60805e3f3d2d5d/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:26.365871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20462d-02fb-4a0a-a793-0469cc2b23f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52a750568fc447e829e22e724219a6b, user_id=d4b1ab8e50754ca28e60805e3f3d2d5d, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:26.372907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20462d-02fb-4a0a-a793-0469cc2b23f2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:26.403478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 833/1659] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:26 2022] PUT /identity/v3/projects/e52a750568fc447e829e22e724219a6b/users/d4b1ab8e50754ca28e60805e3f3d2d5d/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:26.414809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33f39-0ec0-4320-8453-a6b6f467c3b5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:26.415093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33f39-0ec0-4320-8453-a6b6f467c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:26.420692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b33f39-0ec0-4320-8453-a6b6f467c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:26.508526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f8b33f39-0ec0-4320-8453-a6b6f467c3b5 None None] MFA Rules not processed for user `d4b1ab8e50754ca28e60805e3f3d2d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:26.511038 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f8b33f39-0ec0-4320-8453-a6b6f467c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:26.791268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 827/1660] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:26.792074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20462d-02fb-4a0a-a793-0469cc2b23f2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:26.976470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20462d-02fb-4a0a-a793-0469cc2b23f2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:26.984243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc655f-dbad-484a-9002-d83be2ea2135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:26.994328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc655f-dbad-484a-9002-d83be2ea2135 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:26.994610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc655f-dbad-484a-9002-d83be2ea2135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:26.995064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc655f-dbad-484a-9002-d83be2ea2135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:26.995743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc655f-dbad-484a-9002-d83be2ea2135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:26.998352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc655f-dbad-484a-9002-d83be2ea2135 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:27.057723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b33f39-0ec0-4320-8453-a6b6f467c3b5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:27.058107 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 834/1661] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:26 2022] POST /identity/v3/projects => generated 365 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:13:27.070775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b33f39-0ec0-4320-8453-a6b6f467c3b5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:27.145001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:27.237760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23802b-b5de-4d05-89aa-962841b1b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:27.238394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23802b-b5de-4d05-89aa-962841b1b076 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:27.238675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23802b-b5de-4d05-89aa-962841b1b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:27.238952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23802b-b5de-4d05-89aa-962841b1b076 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:27.239604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23802b-b5de-4d05-89aa-962841b1b076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:27.241788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23802b-b5de-4d05-89aa-962841b1b076 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:27.289605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 828/1662] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:27 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:27.293890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc655f-dbad-484a-9002-d83be2ea2135 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:27.307681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc655f-dbad-484a-9002-d83be2ea2135 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:27.321100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09d8c6-983b-4764-9c63-628c3667da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:27.322319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d8c6-983b-4764-9c63-628c3667da30 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:27.322829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d8c6-983b-4764-9c63-628c3667da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:27.323266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d8c6-983b-4764-9c63-628c3667da30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:27.325289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09d8c6-983b-4764-9c63-628c3667da30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:27.331661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09d8c6-983b-4764-9c63-628c3667da30 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:27.352382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 835/1663] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:27.358226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23802b-b5de-4d05-89aa-962841b1b076 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:27.379291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23802b-b5de-4d05-89aa-962841b1b076 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:27.388515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d25eb-7fda-4e50-ac04-1c1aa4b6478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:27.389463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d25eb-7fda-4e50-ac04-1c1aa4b6478f admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:27.389908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d25eb-7fda-4e50-ac04-1c1aa4b6478f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:27.390328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d25eb-7fda-4e50-ac04-1c1aa4b6478f admin admin] PATH_INFO: `/v3/projects/38c25946e1db4246bf3ee226b4721a57/users/b1b8e2f6d81948f9a22c77ba468422c4/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:27.425044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d25eb-7fda-4e50-ac04-1c1aa4b6478f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c25946e1db4246bf3ee226b4721a57, user_id=b1b8e2f6d81948f9a22c77ba468422c4, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:27.428145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d25eb-7fda-4e50-ac04-1c1aa4b6478f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:27.457321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 829/1664] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:27 2022] PUT /identity/v3/projects/38c25946e1db4246bf3ee226b4721a57/users/b1b8e2f6d81948f9a22c77ba468422c4/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:27.461100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09d8c6-983b-4764-9c63-628c3667da30 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:27.475606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09d8c6-983b-4764-9c63-628c3667da30 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:27.646630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034e31-0562-45fd-9048-a0750d4cb4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:27.647447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034e31-0562-45fd-9048-a0750d4cb4cf admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:27.647791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034e31-0562-45fd-9048-a0750d4cb4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:27.647994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034e31-0562-45fd-9048-a0750d4cb4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:27.648646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034e31-0562-45fd-9048-a0750d4cb4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:27.651425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034e31-0562-45fd-9048-a0750d4cb4cf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:27.686682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 836/1665] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:27.691384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d25eb-7fda-4e50-ac04-1c1aa4b6478f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:27.717651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d25eb-7fda-4e50-ac04-1c1aa4b6478f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:27.765636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:27.770622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:27.770917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:27.771198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] PATH_INFO: `/v3/projects/38c25946e1db4246bf3ee226b4721a57/users/b1b8e2f6d81948f9a22c77ba468422c4/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:27.780157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c25946e1db4246bf3ee226b4721a57, user_id=b1b8e2f6d81948f9a22c77ba468422c4, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:27.795029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:27.843744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 830/1666] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:27 2022] PUT /identity/v3/projects/38c25946e1db4246bf3ee226b4721a57/users/b1b8e2f6d81948f9a22c77ba468422c4/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:27.853677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76b6f-4dd2-4680-bcd7-c2b90a6de442 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:27.854510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76b6f-4dd2-4680-bcd7-c2b90a6de442 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:27.854958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76b6f-4dd2-4680-bcd7-c2b90a6de442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:27.936623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4be76b6f-4dd2-4680-bcd7-c2b90a6de442 None None] MFA Rules not processed for user `b1b8e2f6d81948f9a22c77ba468422c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:27.938102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4be76b6f-4dd2-4680-bcd7-c2b90a6de442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:27.975464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:28.161934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 837/1667] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:28.176947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:28.180012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:28.369373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b8ba-cb97-4315-ad99-b3ed97a55590 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:28.386187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:28.387981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:28.388268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:28.388546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:28.432528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:28.439378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:28.477256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 831/1668] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:29.077317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be76b6f-4dd2-4680-bcd7-c2b90a6de442 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:29.080373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4be76b6f-4dd2-4680-bcd7-c2b90a6de442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:29.176966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:29.179236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:29.294788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be76b6f-4dd2-4680-bcd7-c2b90a6de442 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:29.310626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:29.311534 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:29.312084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:29.313594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] PATH_INFO: `/v3/projects/e8c1bd67ce014e3ca985da76a9a99eec` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:29.317265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c1bd67ce014e3ca985da76a9a99eec)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:29.322072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:29.382703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5855-0374-44bc-bf68-158483ffe832 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:29.398110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:29.400359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:29.401098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:29.401802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] PATH_INFO: `/v3/users/82c57dc9d6ec4bc78631bea0bef77410` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:29.409771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c57dc9d6ec4bc78631bea0bef77410)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:29.414937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:29.521089 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c1bd67ce014e3ca985da76a9a99eec', 'request_id': 'req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.564423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c1bd67ce014e3ca985da76a9a99eec', 'request_id': 'req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.568850 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.589121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c1bd67ce014e3ca985da76a9a99eec', 'request_id': 'req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.607087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c57dc9d6ec4bc78631bea0bef77410'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.632784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] The token cache is being invalidate because project e8c1bd67ce014e3ca985da76a9a99eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:29.634749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.642786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.647278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 838/1669] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:29 2022] DELETE /identity/v3/projects/e8c1bd67ce014e3ca985da76a9a99eec => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:29.659372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:29.665154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:29.680505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c57dc9d6ec4bc78631bea0bef77410'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.711838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c57dc9d6ec4bc78631bea0bef77410'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.714147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c57dc9d6ec4bc78631bea0bef77410'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.761930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a143718f-ad94-401e-b8da-b6c5199d899b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c57dc9d6ec4bc78631bea0bef77410'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:29.808083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 832/1670] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:29 2022] DELETE /identity/v3/users/82c57dc9d6ec4bc78631bea0bef77410 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:29.811750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee7b0b-1c61-4fec-a4bc-82b66b8ebc4a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:29.812254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee7b0b-1c61-4fec-a4bc-82b66b8ebc4a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:29.813768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee7b0b-1c61-4fec-a4bc-82b66b8ebc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:29.875029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.907827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2dee7b0b-1c61-4fec-a4bc-82b66b8ebc4a None None] MFA Rules not processed for user `e67e4e9e8c2c41c68dd7dd92a3297e93`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:29.913385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2dee7b0b-1c61-4fec-a4bc-82b66b8ebc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:29.935282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9af2b2-c02d-4c5f-ab2a-15b5d72d2760 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:30.090914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:30.092087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:30.092604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:30.093241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] PATH_INFO: `/v3/users/1893befe74e4405bb09917694305f2a1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:30.095330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1893befe74e4405bb09917694305f2a1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:30.098159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:30.111209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 833/1671] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:30.113719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0245a5-d123-491e-868a-2229209fc985 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:30.115820 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0245a5-d123-491e-868a-2229209fc985 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:30.116218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0245a5-d123-491e-868a-2229209fc985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:30.155531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3f0245a5-d123-491e-868a-2229209fc985 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:30.157577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3f0245a5-d123-491e-868a-2229209fc985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:30.168670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 834/1672] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:30.169795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0245a5-d123-491e-868a-2229209fc985 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:30.171258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3f0245a5-d123-491e-868a-2229209fc985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:30.195815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0245a5-d123-491e-868a-2229209fc985 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:30.207899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1893befe74e4405bb09917694305f2a1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.209273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:30.209966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:30.213359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:30.213680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] PATH_INFO: `/v3/users/d4b1ab8e50754ca28e60805e3f3d2d5d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:30.218086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b1ab8e50754ca28e60805e3f3d2d5d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:30.223407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:30.232769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1893befe74e4405bb09917694305f2a1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.282109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1893befe74e4405bb09917694305f2a1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.287176 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1893befe74e4405bb09917694305f2a1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.304678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1893befe74e4405bb09917694305f2a1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.318736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 839/1673] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:29 2022] DELETE /identity/v3/users/1893befe74e4405bb09917694305f2a1 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:30.320071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:30.334138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b1ab8e50754ca28e60805e3f3d2d5d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.338388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:30.373351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b1ab8e50754ca28e60805e3f3d2d5d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.392806 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b1ab8e50754ca28e60805e3f3d2d5d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.394086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b1ab8e50754ca28e60805e3f3d2d5d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.408843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b1ab8e50754ca28e60805e3f3d2d5d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:30.428078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 835/1674] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:30 2022] DELETE /identity/v3/users/d4b1ab8e50754ca28e60805e3f3d2d5d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:30.429458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:30.435024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:30.457806 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:30.633151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:30.645610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15138109-174a-42b5-bf48-5f2a19896835 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:30.651985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19a84f-c525-4184-8281-8329cb5eb847 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:30.672254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ba0b-f5f7-4860-b51c-3439cce02f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:30.672909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ba0b-f5f7-4860-b51c-3439cce02f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:30.673194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ba0b-f5f7-4860-b51c-3439cce02f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:30.673492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ba0b-f5f7-4860-b51c-3439cce02f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:30.689791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1799ba0b-f5f7-4860-b51c-3439cce02f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:30.876454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:30.878662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:30.878961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:30.879303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:30.881447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799ba0b-f5f7-4860-b51c-3439cce02f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:30.881862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:30.883560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799ba0b-f5f7-4860-b51c-3439cce02f7d service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:30.900860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 836/1675] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:30.902553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d079c-00ec-41c6-a13c-c11be09c466b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:30.902981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d079c-00ec-41c6-a13c-c11be09c466b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:30.903268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d079c-00ec-41c6-a13c-c11be09c466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:30.929506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-437d079c-00ec-41c6-a13c-c11be09c466b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:30.931067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-437d079c-00ec-41c6-a13c-c11be09c466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:30.943350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 837/1676] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:30.966877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d079c-00ec-41c6-a13c-c11be09c466b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:30.977893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d079c-00ec-41c6-a13c-c11be09c466b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:30.983906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:30.985448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:30.985915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:30.986384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:31.007250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:31.008996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:31.026269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 838/1677] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:13:31.042301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:31.044618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:31.064981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 840/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:31.403005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:31.404484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:31.426032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eb08c-6a2e-432c-a39f-5eed2ffdc859 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:31.435454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:31.436480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:31.436856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:31.437449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] PATH_INFO: `/v3/users/768145b7184e4380a22ae5df2aba17d0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:31.439041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768145b7184e4380a22ae5df2aba17d0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:31.441394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:31.516591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:31.518237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:31.542770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3b33e-9277-467a-be7a-01d588d18bbe service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:31.570032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:31.575580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:31.576084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:31.576421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] PATH_INFO: `/v3/projects/dd927f302e0b48eca1f5bbaea194207b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:31.584183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd927f302e0b48eca1f5bbaea194207b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:31.590532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:31.602467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768145b7184e4380a22ae5df2aba17d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.657036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768145b7184e4380a22ae5df2aba17d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.682937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768145b7184e4380a22ae5df2aba17d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.683782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768145b7184e4380a22ae5df2aba17d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.702368 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54b4f55f-0cbe-4f6d-ad91-aa173003bc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768145b7184e4380a22ae5df2aba17d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.727373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 839/1679] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:31 2022] DELETE /identity/v3/users/768145b7184e4380a22ae5df2aba17d0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:31.731176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168596d5-3d4c-4f30-a3d6-02a0aab599fa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:31.732827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168596d5-3d4c-4f30-a3d6-02a0aab599fa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:31.733442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168596d5-3d4c-4f30-a3d6-02a0aab599fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:31.759493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd927f302e0b48eca1f5bbaea194207b', 'request_id': 'req-5dae3b21-2f66-4841-acc8-a59fd148ef03'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.778928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd927f302e0b48eca1f5bbaea194207b', 'request_id': 'req-5dae3b21-2f66-4841-acc8-a59fd148ef03'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.788010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-168596d5-3d4c-4f30-a3d6-02a0aab599fa None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:31.791237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-168596d5-3d4c-4f30-a3d6-02a0aab599fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:31.793965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd927f302e0b48eca1f5bbaea194207b', 'request_id': 'req-5dae3b21-2f66-4841-acc8-a59fd148ef03'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.803297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:31.828073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] The token cache is being invalidate because project dd927f302e0b48eca1f5bbaea194207b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:31.828391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.831711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5dae3b21-2f66-4841-acc8-a59fd148ef03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:31.843815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 841/1680] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:31 2022] DELETE /identity/v3/projects/dd927f302e0b48eca1f5bbaea194207b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:31.849097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca60dc-2ddb-481c-a548-0024f8703f72 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:31.850625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca60dc-2ddb-481c-a548-0024f8703f72 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:31.850905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca60dc-2ddb-481c-a548-0024f8703f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:31.906143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-13ca60dc-2ddb-481c-a548-0024f8703f72 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:31.907577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-13ca60dc-2ddb-481c-a548-0024f8703f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:31.953800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:31.967474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 840/1681] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:31.988006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168596d5-3d4c-4f30-a3d6-02a0aab599fa None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:31.989886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-168596d5-3d4c-4f30-a3d6-02a0aab599fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:32.079917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 842/1682] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:32.082567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c9a61-8a55-4505-94cd-734f9bd5928f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.083459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c9a61-8a55-4505-94cd-734f9bd5928f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.083750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c9a61-8a55-4505-94cd-734f9bd5928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.151713 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-283c9a61-8a55-4505-94cd-734f9bd5928f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:32.154397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-283c9a61-8a55-4505-94cd-734f9bd5928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:32.155937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168596d5-3d4c-4f30-a3d6-02a0aab599fa None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.161168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.162212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.162650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.163062 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.184334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 843/1683] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:32.185771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c9a61-8a55-4505-94cd-734f9bd5928f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.187842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.189475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.210974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c9a61-8a55-4505-94cd-734f9bd5928f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.216433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 841/1684] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:32.217513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.224733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:32.225649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.226351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.226632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.226902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.229773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:32.230087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.236650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.251847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84797-00d8-44da-8f03-65499bca498e service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.265640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.266312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.266592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.266868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] PATH_INFO: `/v3/projects/2423dbb8cf0c49328f18a267a043d8d1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.269649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2423dbb8cf0c49328f18a267a043d8d1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.273594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 844/1685] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:32.273893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.274928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.297323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be9d92-47c7-4915-b147-5d5e1281dfb4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.312081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01da6-9c18-49e8-a901-906689a7b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.312963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01da6-9c18-49e8-a901-906689a7b4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.313217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01da6-9c18-49e8-a901-906689a7b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.313618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01da6-9c18-49e8-a901-906689a7b4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.314361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d01da6-9c18-49e8-a901-906689a7b4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.317068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d01da6-9c18-49e8-a901-906689a7b4d7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.385465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 845/1686] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:32 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:32.387315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01da6-9c18-49e8-a901-906689a7b4d7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.403395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2423dbb8cf0c49328f18a267a043d8d1', 'request_id': 'req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.419703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2423dbb8cf0c49328f18a267a043d8d1', 'request_id': 'req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.432883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2423dbb8cf0c49328f18a267a043d8d1', 'request_id': 'req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.465591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] The token cache is being invalidate because project 2423dbb8cf0c49328f18a267a043d8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:32.465900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.466627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c70ba792-fdc3-4e0f-86bd-2a5827cf5aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.468217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 842/1687] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:32 2022] DELETE /identity/v3/projects/2423dbb8cf0c49328f18a267a043d8d1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:32.474924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6fc9-0868-4e9b-8ccd-7a121f9bea71 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.474924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6fc9-0868-4e9b-8ccd-7a121f9bea71 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.474924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6fc9-0868-4e9b-8ccd-7a121f9bea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.534889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-26bd6fc9-0868-4e9b-8ccd-7a121f9bea71 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:32.536106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01da6-9c18-49e8-a901-906689a7b4d7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.538567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-26bd6fc9-0868-4e9b-8ccd-7a121f9bea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:32.549871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.550936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.551225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.552639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.555284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.559378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 843/1688] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:32.562638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.566590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ab28-8403-4e62-8772-1486ca766f6c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.567267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ab28-8403-4e62-8772-1486ca766f6c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.567559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ab28-8403-4e62-8772-1486ca766f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.608917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-abc0ab28-8403-4e62-8772-1486ca766f6c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:32.610163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-abc0ab28-8403-4e62-8772-1486ca766f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:32.622626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 846/1689] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:32 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:32.623714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.626188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:32.638791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 844/1690] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:13:32.639913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0ab28-8403-4e62-8772-1486ca766f6c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.656126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0ab28-8403-4e62-8772-1486ca766f6c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.665932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e0efb-2e4b-495a-90a1-7f69c986a28c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.667080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.670353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.671936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.674248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.676072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:32.677111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.679730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.681134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.681449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.681730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.683072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.686070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.689250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.723747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 847/1691] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:32.727459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.732737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:32.750816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 845/1692] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:13:32.751978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.769578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8467-5fed-4fe1-9cf7-93eb70f51277 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.773993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca0ec-4dff-464c-97e6-8a99df146822 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.783226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8db7-ba71-4aa2-a6b2-b25abd0199d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.784898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8db7-ba71-4aa2-a6b2-b25abd0199d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.785206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8db7-ba71-4aa2-a6b2-b25abd0199d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.785494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e8db7-ba71-4aa2-a6b2-b25abd0199d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.786246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e8db7-ba71-4aa2-a6b2-b25abd0199d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.787446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.787902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e8db7-ba71-4aa2-a6b2-b25abd0199d2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.788290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.788580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.789321 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] PATH_INFO: `/v3/projects/e52a750568fc447e829e22e724219a6b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.791175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:32.792887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52a750568fc447e829e22e724219a6b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.797823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.803454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 846/1693] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:32.808273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8db7-ba71-4aa2-a6b2-b25abd0199d2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.829156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e8db7-ba71-4aa2-a6b2-b25abd0199d2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:32.837740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745af276-8abe-4522-9cf5-bb63bdbb3887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:32.838549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745af276-8abe-4522-9cf5-bb63bdbb3887 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:32.838905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745af276-8abe-4522-9cf5-bb63bdbb3887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:32.839255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745af276-8abe-4522-9cf5-bb63bdbb3887 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:32.840900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745af276-8abe-4522-9cf5-bb63bdbb3887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:32.842641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745af276-8abe-4522-9cf5-bb63bdbb3887 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:32.887255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 847/1694] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:32 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:32.888755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745af276-8abe-4522-9cf5-bb63bdbb3887 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.916913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52a750568fc447e829e22e724219a6b', 'request_id': 'req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.930890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:32.933034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52a750568fc447e829e22e724219a6b', 'request_id': 'req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.948474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52a750568fc447e829e22e724219a6b', 'request_id': 'req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.979120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] The token cache is being invalidate because project e52a750568fc447e829e22e724219a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:32.980364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.980606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:32.983000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 848/1695] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:32 2022] DELETE /identity/v3/projects/e52a750568fc447e829e22e724219a6b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:32.983882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:32.988521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:32.993757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745af276-8abe-4522-9cf5-bb63bdbb3887 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:33.080287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:33.081118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.081751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.082198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] PATH_INFO: `/v3/projects/26efb64d2b09474b85da75d9f5c6df35/users/ab61864d62004e41b613c08d0d42f2b7/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.106147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26efb64d2b09474b85da75d9f5c6df35, user_id=ab61864d62004e41b613c08d0d42f2b7, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:33.115016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:33.133701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea33a60-6c1f-49af-8f39-6bf20249e7d8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:33.159208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 848/1696] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:32 2022] PUT /identity/v3/projects/26efb64d2b09474b85da75d9f5c6df35/users/ab61864d62004e41b613c08d0d42f2b7/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:33.160262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:33.163851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:33.265739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ef3d5-0616-4680-bc74-276938e59731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:33.266373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ef3d5-0616-4680-bc74-276938e59731 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.266652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ef3d5-0616-4680-bc74-276938e59731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.266924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ef3d5-0616-4680-bc74-276938e59731 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.267563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ef3d5-0616-4680-bc74-276938e59731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:33.269516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ef3d5-0616-4680-bc74-276938e59731 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:33.313622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 849/1697] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:32 2022] POST /identity/v3/users => generated 287 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:33.315377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536df1cb-aac7-4cfc-8834-e1c66c1668b0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.315848 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536df1cb-aac7-4cfc-8834-e1c66c1668b0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.316502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536df1cb-aac7-4cfc-8834-e1c66c1668b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.347324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007e00c-93f8-48d9-8e04-0c7ad7d47db7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:33.351020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-536df1cb-aac7-4cfc-8834-e1c66c1668b0 None None] MFA Rules not processed for user `ab61864d62004e41b613c08d0d42f2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:33.352452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-536df1cb-aac7-4cfc-8834-e1c66c1668b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:33.360877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:33.361851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.362305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.362773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] PATH_INFO: `/v3/users/b1b8e2f6d81948f9a22c77ba468422c4` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.365126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b8e2f6d81948f9a22c77ba468422c4)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:33.367519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:33.374484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:33.444252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b8e2f6d81948f9a22c77ba468422c4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:33.451877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 850/1698] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:33.455418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536df1cb-aac7-4cfc-8834-e1c66c1668b0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:33.468028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536df1cb-aac7-4cfc-8834-e1c66c1668b0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:33.469371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b8e2f6d81948f9a22c77ba468422c4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:33.479596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:33.480190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b8e2f6d81948f9a22c77ba468422c4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:33.481512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.481617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b8e2f6d81948f9a22c77ba468422c4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:33.483455 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.483947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.485187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:33.487494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:33.491789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b8e2f6d81948f9a22c77ba468422c4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:33.497033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:33.499120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 849/1699] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:33 2022] DELETE /identity/v3/users/b1b8e2f6d81948f9a22c77ba468422c4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:33.499832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:33.501542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:33.513004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 851/1700] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:33.516971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:33.521886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:33.541498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22718db-46f0-496c-a010-61bef7d2d901 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:33.604969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ae5d-d26e-4abe-b001-09d25c9639d0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:33.611330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7833b3-9991-4928-b022-de002a2f8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:33.612513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7833b3-9991-4928-b022-de002a2f8e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.612799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7833b3-9991-4928-b022-de002a2f8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.613152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7833b3-9991-4928-b022-de002a2f8e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.613877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7833b3-9991-4928-b022-de002a2f8e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:33.615866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7833b3-9991-4928-b022-de002a2f8e10 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:33.628661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019057c9-1e64-4262-95fd-6b2bf16bcab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:33.630594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019057c9-1e64-4262-95fd-6b2bf16bcab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.631208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019057c9-1e64-4262-95fd-6b2bf16bcab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.631892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019057c9-1e64-4262-95fd-6b2bf16bcab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.633021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019057c9-1e64-4262-95fd-6b2bf16bcab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:33.637917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019057c9-1e64-4262-95fd-6b2bf16bcab5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:33.663250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 852/1701] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:33.668600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 850/1702] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:33 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:33.668785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019057c9-1e64-4262-95fd-6b2bf16bcab5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:33.675783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7833b3-9991-4928-b022-de002a2f8e10 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:33.701833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019057c9-1e64-4262-95fd-6b2bf16bcab5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:33.821438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb749ff-ebeb-4f37-a5c7-9650e3ae8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:33.822253 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb749ff-ebeb-4f37-a5c7-9650e3ae8ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.822533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb749ff-ebeb-4f37-a5c7-9650e3ae8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.823422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb749ff-ebeb-4f37-a5c7-9650e3ae8ec1 admin admin] PATH_INFO: `/v3/projects/2108eaadfe714bedbda9ed9cbeef67dc/users/a051e32f49094676ae7794f637383213/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.835539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7833b3-9991-4928-b022-de002a2f8e10 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:33.847197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb749ff-ebeb-4f37-a5c7-9650e3ae8ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2108eaadfe714bedbda9ed9cbeef67dc, user_id=a051e32f49094676ae7794f637383213, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:33.850495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb749ff-ebeb-4f37-a5c7-9650e3ae8ec1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:33.850846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb926ce2-9438-4659-a7ff-68fdc7e007dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:33.851696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926ce2-9438-4659-a7ff-68fdc7e007dc admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.852154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926ce2-9438-4659-a7ff-68fdc7e007dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.852595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb926ce2-9438-4659-a7ff-68fdc7e007dc admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.853443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb926ce2-9438-4659-a7ff-68fdc7e007dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:33.856097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb926ce2-9438-4659-a7ff-68fdc7e007dc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:33.876827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:33.889539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 853/1703] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:33 2022] PUT /identity/v3/projects/2108eaadfe714bedbda9ed9cbeef67dc/users/a051e32f49094676ae7794f637383213/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:13:33.895519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2cd4-fa3f-4450-9d9a-d0aadc271178 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:33.897626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 851/1704] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:33 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:33.899868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2cd4-fa3f-4450-9d9a-d0aadc271178 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:33.900237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2cd4-fa3f-4450-9d9a-d0aadc271178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:33.901861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb926ce2-9438-4659-a7ff-68fdc7e007dc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:33.915084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb926ce2-9438-4659-a7ff-68fdc7e007dc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:34.006950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-362f2cd4-fa3f-4450-9d9a-d0aadc271178 None None] MFA Rules not processed for user `a051e32f49094676ae7794f637383213`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:34.008877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-362f2cd4-fa3f-4450-9d9a-d0aadc271178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:34.020597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:34.021302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.021624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.021902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.022568 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:34.025016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:34.040748 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 852/1705] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:34.042350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:34.044309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:34.060195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41bf59-33c0-4ee2-acf7-5bfac497f2b6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:34.066036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:34.066686 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.067006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.067324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] PATH_INFO: `/v3/projects/38c25946e1db4246bf3ee226b4721a57` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.068512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c25946e1db4246bf3ee226b4721a57)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:34.071926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:34.114656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 854/1706] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:34.114656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2cd4-fa3f-4450-9d9a-d0aadc271178 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:34.134181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2cd4-fa3f-4450-9d9a-d0aadc271178 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:34.148902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:34.149692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.150088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.150701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] PATH_INFO: `/v3/projects/65e67ab9799d40c88c5d7325070dac8b/users/d5abe703b5bc4d1296b7e13cf134fbc9/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.159755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:34.188405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e67ab9799d40c88c5d7325070dac8b, user_id=d5abe703b5bc4d1296b7e13cf134fbc9, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:34.192571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:34.226241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c25946e1db4246bf3ee226b4721a57', 'request_id': 'req-cdbec0c1-5f56-41be-979e-361e4ca890a1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.228373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 855/1707] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:34 2022] PUT /identity/v3/projects/65e67ab9799d40c88c5d7325070dac8b/users/d5abe703b5bc4d1296b7e13cf134fbc9/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:34.229251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:34.234040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:34.244807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c25946e1db4246bf3ee226b4721a57', 'request_id': 'req-cdbec0c1-5f56-41be-979e-361e4ca890a1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.255828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c25946e1db4246bf3ee226b4721a57', 'request_id': 'req-cdbec0c1-5f56-41be-979e-361e4ca890a1'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.285838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] The token cache is being invalidate because project 38c25946e1db4246bf3ee226b4721a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:34.286135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.287692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.298790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 853/1708] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:34 2022] DELETE /identity/v3/projects/38c25946e1db4246bf3ee226b4721a57 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:34.300111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:34.302859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:34.437013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b22c-23e2-493d-b95e-18ad640a8609 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:34.454082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:34.454845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.455233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.455502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.458660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:34.466881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec0c1-5f56-41be-979e-361e4ca890a1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:34.534671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:34.583080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ac953-ac16-43eb-9005-4db26ab31736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:34.583704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac953-ac16-43eb-9005-4db26ab31736 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.583983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac953-ac16-43eb-9005-4db26ab31736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.584254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac953-ac16-43eb-9005-4db26ab31736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.585495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ac953-ac16-43eb-9005-4db26ab31736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:34.586597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ac953-ac16-43eb-9005-4db26ab31736 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:34.603100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 854/1709] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:34.607173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869da2cc-675f-4603-940b-ab30b5179345 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.607595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869da2cc-675f-4603-940b-ab30b5179345 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.607872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869da2cc-675f-4603-940b-ab30b5179345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.624334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:34.626326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:34.649460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-869da2cc-675f-4603-940b-ab30b5179345 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:34.653310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-869da2cc-675f-4603-940b-ab30b5179345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:34.661859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 856/1710] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:34.662881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:34.671307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:34.693432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 855/1711] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:34.694396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869da2cc-675f-4603-940b-ab30b5179345 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:34.698059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51e1c7-6aa3-426f-a805-590e64984e39 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:34.711820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:34.711820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.711820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.712255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] PATH_INFO: `/v3/projects/0c852563d28d4ba7a1a5f86f6b3f7dd5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.713276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c852563d28d4ba7a1a5f86f6b3f7dd5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:34.715486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:34.739538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869da2cc-675f-4603-940b-ab30b5179345 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:34.765489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe9aec-7d91-431d-9b25-fc2610754f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:34.766176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe9aec-7d91-431d-9b25-fc2610754f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.766455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe9aec-7d91-431d-9b25-fc2610754f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.766727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe9aec-7d91-431d-9b25-fc2610754f51 admin admin] PATH_INFO: `/v3/projects/65e67ab9799d40c88c5d7325070dac8b/users/d5abe703b5bc4d1296b7e13cf134fbc9/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.775489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe9aec-7d91-431d-9b25-fc2610754f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e67ab9799d40c88c5d7325070dac8b, user_id=d5abe703b5bc4d1296b7e13cf134fbc9, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:34.783755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe9aec-7d91-431d-9b25-fc2610754f51 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:34.811468 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c852563d28d4ba7a1a5f86f6b3f7dd5', 'request_id': 'req-da960bd5-b92c-4d90-8bcb-51dc81c7494f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.813175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 856/1712] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:34 2022] PUT /identity/v3/projects/65e67ab9799d40c88c5d7325070dac8b/users/d5abe703b5bc4d1296b7e13cf134fbc9/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:34.818132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105a44d-53b9-455a-809e-8b2d3958e51e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.818430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105a44d-53b9-455a-809e-8b2d3958e51e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.818711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105a44d-53b9-455a-809e-8b2d3958e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.836043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c852563d28d4ba7a1a5f86f6b3f7dd5', 'request_id': 'req-da960bd5-b92c-4d90-8bcb-51dc81c7494f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.850784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c852563d28d4ba7a1a5f86f6b3f7dd5', 'request_id': 'req-da960bd5-b92c-4d90-8bcb-51dc81c7494f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.880680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0105a44d-53b9-455a-809e-8b2d3958e51e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:34.881358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] The token cache is being invalidate because project 0c852563d28d4ba7a1a5f86f6b3f7dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:34.881696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.881983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0105a44d-53b9-455a-809e-8b2d3958e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:34.882516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da960bd5-b92c-4d90-8bcb-51dc81c7494f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:34.884423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 857/1713] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:34 2022] DELETE /identity/v3/projects/0c852563d28d4ba7a1a5f86f6b3f7dd5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:34.885956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89629-c6de-430f-a558-4aa89be88247 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:34.886239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89629-c6de-430f-a558-4aa89be88247 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:34.886567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89629-c6de-430f-a558-4aa89be88247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:34.900324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:34.955401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-38a89629-c6de-430f-a558-4aa89be88247 None None] MFA Rules not processed for user `d5abe703b5bc4d1296b7e13cf134fbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:34.956654 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-38a89629-c6de-430f-a558-4aa89be88247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:35.035385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 857/1714] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:35.036301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105a44d-53b9-455a-809e-8b2d3958e51e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:35.040207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0105a44d-53b9-455a-809e-8b2d3958e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:35.073103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105a44d-53b9-455a-809e-8b2d3958e51e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:35.080423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:35.080659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.080887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.081248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] PATH_INFO: `/v3/users/e1f97ae2cc09445ba6aa4decff23cada` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.084225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f97ae2cc09445ba6aa4decff23cada)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:35.090633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:35.120457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 858/1715] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:35.122034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a89629-c6de-430f-a558-4aa89be88247 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:35.151731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a89629-c6de-430f-a558-4aa89be88247 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:35.162459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:35.163311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.163460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.163644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.164482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:35.164790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:35.166675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:35.196940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 859/1716] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:35.197952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:35.204387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f97ae2cc09445ba6aa4decff23cada'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:35.207005 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:35.230864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f97ae2cc09445ba6aa4decff23cada'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:35.248510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f97ae2cc09445ba6aa4decff23cada'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:35.249288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f97ae2cc09445ba6aa4decff23cada'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:35.260552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f97ae2cc09445ba6aa4decff23cada'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:35.275441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 858/1717] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:35 2022] DELETE /identity/v3/users/e1f97ae2cc09445ba6aa4decff23cada => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:35.276160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:35.279980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:35.316957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:35.325540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db938af-2e48-4ea7-98e7-0b8d710962f0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:35.450640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:35.450990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.451745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.451745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.453427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:35.466462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35725-314b-4467-ae4a-81f290024ac4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:35.482862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8dbb5-4de4-4c4e-8049-6fe45aaae7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:35.484704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8dbb5-4de4-4c4e-8049-6fe45aaae7ef admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.486519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8dbb5-4de4-4c4e-8049-6fe45aaae7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.488009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8dbb5-4de4-4c4e-8049-6fe45aaae7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.488777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8dbb5-4de4-4c4e-8049-6fe45aaae7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:35.490807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8dbb5-4de4-4c4e-8049-6fe45aaae7ef admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:35.587786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:35.607367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 859/1718] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:35 2022] POST /identity/v3/projects => generated 367 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:35.608962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc143d5-57d5-49e7-a30a-3412cf6d0dfc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.613079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc143d5-57d5-49e7-a30a-3412cf6d0dfc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.614633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc143d5-57d5-49e7-a30a-3412cf6d0dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.617850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:35.625345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:35.645573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 860/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:35.646442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:35.664837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-efc143d5-57d5-49e7-a30a-3412cf6d0dfc None None] MFA Rules not processed for user `e67e4e9e8c2c41c68dd7dd92a3297e93`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:35.666794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d56ff-e638-47ef-95cc-bd5c50e4a61f service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:35.668175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-efc143d5-57d5-49e7-a30a-3412cf6d0dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:35.813767 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c059c-c3db-47cb-a2bf-20162f149d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:35.814395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c059c-c3db-47cb-a2bf-20162f149d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.814680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c059c-c3db-47cb-a2bf-20162f149d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.814956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c059c-c3db-47cb-a2bf-20162f149d27 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.815642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c059c-c3db-47cb-a2bf-20162f149d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:35.823908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 860/1720] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:35.825015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc143d5-57d5-49e7-a30a-3412cf6d0dfc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:35.827248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-efc143d5-57d5-49e7-a30a-3412cf6d0dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:35.829732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c059c-c3db-47cb-a2bf-20162f149d27 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:35.860096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc143d5-57d5-49e7-a30a-3412cf6d0dfc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:35.876307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:35.876999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.877282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.877581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] PATH_INFO: `/v3/users/ab61864d62004e41b613c08d0d42f2b7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.879768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 861/1721] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:35 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:35.880499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab61864d62004e41b613c08d0d42f2b7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:35.884157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c059c-c3db-47cb-a2bf-20162f149d27 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:35.884648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:35.895145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c059c-c3db-47cb-a2bf-20162f149d27 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:35.900133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2272-d9fc-4fb7-bc20-817f5e386b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:35.900738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2272-d9fc-4fb7-bc20-817f5e386b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.901018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2272-d9fc-4fb7-bc20-817f5e386b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.901290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2272-d9fc-4fb7-bc20-817f5e386b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.901968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2272-d9fc-4fb7-bc20-817f5e386b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:35.904478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2272-d9fc-4fb7-bc20-817f5e386b53 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:35.922203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 862/1722] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:35.923117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2272-d9fc-4fb7-bc20-817f5e386b53 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:35.938998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2272-d9fc-4fb7-bc20-817f5e386b53 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:35.948364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aef94-59c7-4329-b37b-063b74398b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:35.951672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aef94-59c7-4329-b37b-063b74398b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:35.953067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aef94-59c7-4329-b37b-063b74398b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:35.953426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aef94-59c7-4329-b37b-063b74398b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:35.954687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aef94-59c7-4329-b37b-063b74398b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:35.956969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aef94-59c7-4329-b37b-063b74398b08 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:35.987297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab61864d62004e41b613c08d0d42f2b7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:36.006076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 863/1723] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:36.007678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aef94-59c7-4329-b37b-063b74398b08 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:36.029761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab61864d62004e41b613c08d0d42f2b7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:36.039860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aef94-59c7-4329-b37b-063b74398b08 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:36.051129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab61864d62004e41b613c08d0d42f2b7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:36.052009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab61864d62004e41b613c08d0d42f2b7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:36.057433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e618-626e-4f54-bb2c-dd4ecde4e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:36.058963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e618-626e-4f54-bb2c-dd4ecde4e90d admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:36.059253 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e618-626e-4f54-bb2c-dd4ecde4e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:36.059615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e618-626e-4f54-bb2c-dd4ecde4e90d admin admin] PATH_INFO: `/v3/projects/24fc8ec2a7dc4971821f837bd7fcda20/users/be58ea44b3c04667821fe50d668aa5a7/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:36.067739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6d87974b-c033-4d29-acb7-91782cc6a2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab61864d62004e41b613c08d0d42f2b7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:36.087964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 861/1724] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:35 2022] DELETE /identity/v3/users/ab61864d62004e41b613c08d0d42f2b7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:36.092567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c575e3-ec6c-455f-81f9-112c1e6b0f2c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:36.095121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c575e3-ec6c-455f-81f9-112c1e6b0f2c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:36.095460 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c575e3-ec6c-455f-81f9-112c1e6b0f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:36.130657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e618-626e-4f54-bb2c-dd4ecde4e90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fc8ec2a7dc4971821f837bd7fcda20, user_id=be58ea44b3c04667821fe50d668aa5a7, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:36.151195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e618-626e-4f54-bb2c-dd4ecde4e90d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:36.175221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c2c575e3-ec6c-455f-81f9-112c1e6b0f2c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:36.177071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c2c575e3-ec6c-455f-81f9-112c1e6b0f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:36.185049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 864/1725] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:36 2022] PUT /identity/v3/projects/24fc8ec2a7dc4971821f837bd7fcda20/users/be58ea44b3c04667821fe50d668aa5a7/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:36.187289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58b4a-3124-4703-9a71-0115980b5360 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:36.187580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58b4a-3124-4703-9a71-0115980b5360 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:36.187853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58b4a-3124-4703-9a71-0115980b5360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:36.213561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:36.229249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-80a58b4a-3124-4703-9a71-0115980b5360 None None] MFA Rules not processed for user `be58ea44b3c04667821fe50d668aa5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:36.231412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-80a58b4a-3124-4703-9a71-0115980b5360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:36.372762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 862/1726] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:36.394847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 865/1727] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:36.399419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c575e3-ec6c-455f-81f9-112c1e6b0f2c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:36.400864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c2c575e3-ec6c-455f-81f9-112c1e6b0f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:36.427700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c575e3-ec6c-455f-81f9-112c1e6b0f2c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:36.428401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a58b4a-3124-4703-9a71-0115980b5360 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:36.429843 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-80a58b4a-3124-4703-9a71-0115980b5360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:36.445516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bccf0-c751-42b6-97a0-a413f0ccb078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:36.447506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bccf0-c751-42b6-97a0-a413f0ccb078 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:36.448027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bccf0-c751-42b6-97a0-a413f0ccb078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:36.449862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bccf0-c751-42b6-97a0-a413f0ccb078 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:36.451038 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bccf0-c751-42b6-97a0-a413f0ccb078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:36.454142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bccf0-c751-42b6-97a0-a413f0ccb078 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:36.465955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:36.531659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 863/1728] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:36 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:36.535642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bccf0-c751-42b6-97a0-a413f0ccb078 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:36.559082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a58b4a-3124-4703-9a71-0115980b5360 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:36.701461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a47b4d-9a5d-4b1d-b25a-bfe33ce0f02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:36.702656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47b4d-9a5d-4b1d-b25a-bfe33ce0f02e service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:36.702906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47b4d-9a5d-4b1d-b25a-bfe33ce0f02e service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:36.722815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47b4d-9a5d-4b1d-b25a-bfe33ce0f02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:36.733024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bccf0-c751-42b6-97a0-a413f0ccb078 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:36.747635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816abfe-1745-48a7-8c73-aacea625602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:36.748265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816abfe-1745-48a7-8c73-aacea625602b admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:36.748545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816abfe-1745-48a7-8c73-aacea625602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:36.748814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816abfe-1745-48a7-8c73-aacea625602b admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:36.750118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816abfe-1745-48a7-8c73-aacea625602b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:36.756906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816abfe-1745-48a7-8c73-aacea625602b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:36.758799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a47b4d-9a5d-4b1d-b25a-bfe33ce0f02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:36.762996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a47b4d-9a5d-4b1d-b25a-bfe33ce0f02e service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:36.832064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 866/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:36.837493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 864/1730] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:36 2022] POST /identity/v3/users => generated 290 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:36.841350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a47b4d-9a5d-4b1d-b25a-bfe33ce0f02e service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:36.862187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a47b4d-9a5d-4b1d-b25a-bfe33ce0f02e service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:36.867843 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77cff8-2ebc-49f0-8c61-5b286f3537ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:36.868675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77cff8-2ebc-49f0-8c61-5b286f3537ab admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:36.869063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77cff8-2ebc-49f0-8c61-5b286f3537ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:36.869598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77cff8-2ebc-49f0-8c61-5b286f3537ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:36.884060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77cff8-2ebc-49f0-8c61-5b286f3537ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:36.886091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77cff8-2ebc-49f0-8c61-5b286f3537ab admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:36.957061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 867/1731] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:13:36.961612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816abfe-1745-48a7-8c73-aacea625602b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:36.976379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816abfe-1745-48a7-8c73-aacea625602b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:36.993688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531899-486e-476b-a718-13c124b6c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:36.994305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531899-486e-476b-a718-13c124b6c4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:36.994581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531899-486e-476b-a718-13c124b6c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:36.994857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531899-486e-476b-a718-13c124b6c4f8 admin admin] PATH_INFO: `/v3/projects/74a589bdc328486786eabd391338d814/users/1b70df25e80849fba31e3b648869749b/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:37.039307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a531899-486e-476b-a718-13c124b6c4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a589bdc328486786eabd391338d814, user_id=1b70df25e80849fba31e3b648869749b, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:37.042416 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a531899-486e-476b-a718-13c124b6c4f8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:37.094574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77cff8-2ebc-49f0-8c61-5b286f3537ab admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:37.116801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 865/1732] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:36 2022] PUT /identity/v3/projects/74a589bdc328486786eabd391338d814/users/1b70df25e80849fba31e3b648869749b/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:37.122290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77cff8-2ebc-49f0-8c61-5b286f3537ab admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:37.161335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd58137-c8ca-4b38-be5f-f2655aa3c5ff None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:37.161553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd58137-c8ca-4b38-be5f-f2655aa3c5ff None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:37.161807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd58137-c8ca-4b38-be5f-f2655aa3c5ff None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:37.163358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 866/1733] 10.222.0.20 () {54 vars in 912 bytes} [Thu Sep 8 01:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 01:13:37.183060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652c71-7918-4710-8c7c-5907405e7aeb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:37.183996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652c71-7918-4710-8c7c-5907405e7aeb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:37.184279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652c71-7918-4710-8c7c-5907405e7aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:37.312226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2c652c71-7918-4710-8c7c-5907405e7aeb None None] MFA Rules not processed for user `5a6ff1b9371a411bae7b3e45f78e05e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:37.314689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2c652c71-7918-4710-8c7c-5907405e7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:37.377676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860f7d7-a3db-4888-8608-d2956a270ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:37.380775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860f7d7-a3db-4888-8608-d2956a270ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:37.381479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860f7d7-a3db-4888-8608-d2956a270ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:37.382762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860f7d7-a3db-4888-8608-d2956a270ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:37.389326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860f7d7-a3db-4888-8608-d2956a270ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:37.391815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860f7d7-a3db-4888-8608-d2956a270ea2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:37.453653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 868/1734] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:37.456581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860f7d7-a3db-4888-8608-d2956a270ea2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:37.457845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:37.477621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 867/1735] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:13:37.488229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860f7d7-a3db-4888-8608-d2956a270ea2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:37.494383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87e70d-db20-47b2-b558-1c8b2c3cfe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:37.495180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e70d-db20-47b2-b558-1c8b2c3cfe62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:37.496306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e70d-db20-47b2-b558-1c8b2c3cfe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:37.496660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e70d-db20-47b2-b558-1c8b2c3cfe62 admin admin] PATH_INFO: `/v3/projects/74a589bdc328486786eabd391338d814/users/1b70df25e80849fba31e3b648869749b/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:37.499915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e70d-db20-47b2-b558-1c8b2c3cfe62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a589bdc328486786eabd391338d814, user_id=1b70df25e80849fba31e3b648869749b, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:37.508432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e70d-db20-47b2-b558-1c8b2c3cfe62 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:37.519465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652c71-7918-4710-8c7c-5907405e7aeb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:37.521101 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2c652c71-7918-4710-8c7c-5907405e7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:37.541749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652c71-7918-4710-8c7c-5907405e7aeb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:37.547927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 869/1736] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:37 2022] PUT /identity/v3/projects/74a589bdc328486786eabd391338d814/users/1b70df25e80849fba31e3b648869749b/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:37.561683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b5ac-2e40-46f3-ab70-bab53c53c0c4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:37.566071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b5ac-2e40-46f3-ab70-bab53c53c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:37.568287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b5ac-2e40-46f3-ab70-bab53c53c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:37.676636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7283b5ac-2e40-46f3-ab70-bab53c53c0c4 None None] MFA Rules not processed for user `1b70df25e80849fba31e3b648869749b`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:37.677905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7283b5ac-2e40-46f3-ab70-bab53c53c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:37.683123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:37.683984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:37.684374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:37.684525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:37.745483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:37.748058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:37.798665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 868/1737] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:13:37.799619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:37.802801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:37.804256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:37.956130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 870/1738] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:37.974385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283b5ac-2e40-46f3-ab70-bab53c53c0c4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:37.975821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7283b5ac-2e40-46f3-ab70-bab53c53c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:38.048669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c753-5bc9-4311-9da6-bb1adf4c80a4 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:38.054401 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:38.055086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:38.055374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:38.055671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] PATH_INFO: `/v3/projects/c712b860941d49b0bc90469c00f74ea6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:38.062266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c712b860941d49b0bc90469c00f74ea6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:38.066018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:38.178436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283b5ac-2e40-46f3-ab70-bab53c53c0c4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:38.235715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c712b860941d49b0bc90469c00f74ea6', 'request_id': 'req-2e45fa27-592b-4631-a0c3-e72a62cd0705'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:38.259977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c712b860941d49b0bc90469c00f74ea6', 'request_id': 'req-2e45fa27-592b-4631-a0c3-e72a62cd0705'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:38.281426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c712b860941d49b0bc90469c00f74ea6', 'request_id': 'req-2e45fa27-592b-4631-a0c3-e72a62cd0705'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:38.333278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] The token cache is being invalidate because project c712b860941d49b0bc90469c00f74ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:38.336110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:38.337884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2e45fa27-592b-4631-a0c3-e72a62cd0705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:38.341842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:38.342659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:38.342919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:38.343301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:38.347083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 869/1739] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:37 2022] DELETE /identity/v3/projects/c712b860941d49b0bc90469c00f74ea6 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:38.347236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:38.349661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e91c9-672d-4f3b-ae7f-ba4a784c1cd9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:38.350610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e91c9-672d-4f3b-ae7f-ba4a784c1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:38.351567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e91c9-672d-4f3b-ae7f-ba4a784c1cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:38.397339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-739e91c9-672d-4f3b-ae7f-ba4a784c1cd9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:38.400633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-739e91c9-672d-4f3b-ae7f-ba4a784c1cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:38.502335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:38.548880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:38.552206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:38.613901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 871/1740] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:13:38.618104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:38.622352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:38.648461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 870/1741] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:13:38.658936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71bda-d5c1-4be4-afe1-4a5c2adb483a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:38.659231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71bda-d5c1-4be4-afe1-4a5c2adb483a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:38.659515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71bda-d5c1-4be4-afe1-4a5c2adb483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:38.679173 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce27d0f-7c81-4425-88a0-1f42181258a7 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:38.734898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:38.735639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:38.735928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:38.739019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] PATH_INFO: `/v3/users/a051e32f49094676ae7794f637383213` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:38.750895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a051e32f49094676ae7794f637383213)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:38.752972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:38.782028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-86c71bda-d5c1-4be4-afe1-4a5c2adb483a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:38.783320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-86c71bda-d5c1-4be4-afe1-4a5c2adb483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:38.845566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 871/1742] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:38.852381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71bda-d5c1-4be4-afe1-4a5c2adb483a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:38.888615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71bda-d5c1-4be4-afe1-4a5c2adb483a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:38.897672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:38.898689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:38.899532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:38.900001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:38.901074 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:38.901797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:38.904800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:38.927314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 872/1743] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:38.928315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:38.938603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:38.940439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:38.959791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59e7c4-4b1d-4426-988f-c54e4e17902a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:38.964479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:38.973814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:38.973814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:38.973814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:38.975874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:38.977342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a051e32f49094676ae7794f637383213'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:38.999315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a051e32f49094676ae7794f637383213'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:39.056631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a051e32f49094676ae7794f637383213'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:39.056631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a051e32f49094676ae7794f637383213'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:39.060602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a051e32f49094676ae7794f637383213'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:39.083384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 872/1744] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:38 2022] DELETE /identity/v3/users/a051e32f49094676ae7794f637383213 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:39.083384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:39.083694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:39.093975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:39.095980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:39.112201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 873/1745] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:39.113274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:39.115188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:39.229894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f9f48-2b3a-4a5d-a0ff-a398e87d94c5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:39.236861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25b98d-fc43-4eab-bf00-b8747596d155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:39.237526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25b98d-fc43-4eab-bf00-b8747596d155 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:39.237812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25b98d-fc43-4eab-bf00-b8747596d155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:39.238093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25b98d-fc43-4eab-bf00-b8747596d155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:39.238755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25b98d-fc43-4eab-bf00-b8747596d155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:39.243165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25b98d-fc43-4eab-bf00-b8747596d155 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:39.288019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bde00-b140-4dac-903e-ade0b12a0834 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:39.293778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 873/1746] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:39 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:39.293778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3435b8-5215-4427-9d65-ba163cdf3b22 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:39.293778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3435b8-5215-4427-9d65-ba163cdf3b22 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:39.293778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3435b8-5215-4427-9d65-ba163cdf3b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:39.328674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1d3435b8-5215-4427-9d65-ba163cdf3b22 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:39.331460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1d3435b8-5215-4427-9d65-ba163cdf3b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:39.406590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:39.444358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:39.446429 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:39.447360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:39.447491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:39.452841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:39.473987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 874/1747] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:39.475205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3435b8-5215-4427-9d65-ba163cdf3b22 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:39.497508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3435b8-5215-4427-9d65-ba163cdf3b22 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:39.499725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:39.507695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:39.522900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67092a6c-381d-4404-b23a-1c408de429b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:39.523368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092a6c-381d-4404-b23a-1c408de429b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:39.524046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092a6c-381d-4404-b23a-1c408de429b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:39.524046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092a6c-381d-4404-b23a-1c408de429b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:39.524544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67092a6c-381d-4404-b23a-1c408de429b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:39.526613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67092a6c-381d-4404-b23a-1c408de429b4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:39.549047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 874/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:39.550209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:39.554365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:39.564535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 875/1749] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:39 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:39.568454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67092a6c-381d-4404-b23a-1c408de429b4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:39.587147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67092a6c-381d-4404-b23a-1c408de429b4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:39.598277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08704c53-068d-4522-bf80-c6fd2a62509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:39.599188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08704c53-068d-4522-bf80-c6fd2a62509b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:39.599478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08704c53-068d-4522-bf80-c6fd2a62509b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:39.599755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08704c53-068d-4522-bf80-c6fd2a62509b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:39.600415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08704c53-068d-4522-bf80-c6fd2a62509b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:39.602080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08704c53-068d-4522-bf80-c6fd2a62509b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:39.651034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 876/1750] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:39.657233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08704c53-068d-4522-bf80-c6fd2a62509b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:39.680632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a752b-8e3b-44f4-94ce-de07529ce560 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:39.692734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172340-6b44-435f-96d2-fffdf425b106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:39.693520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172340-6b44-435f-96d2-fffdf425b106 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:39.693920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172340-6b44-435f-96d2-fffdf425b106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:39.694466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172340-6b44-435f-96d2-fffdf425b106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:39.718035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08704c53-068d-4522-bf80-c6fd2a62509b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:39.720530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba172340-6b44-435f-96d2-fffdf425b106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:39.722278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba172340-6b44-435f-96d2-fffdf425b106 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:39.751500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52477-6863-49af-ac52-64256277f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:39.752137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52477-6863-49af-ac52-64256277f0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:39.752588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52477-6863-49af-ac52-64256277f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:39.753506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52477-6863-49af-ac52-64256277f0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:39.755324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52477-6863-49af-ac52-64256277f0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:39.757014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52477-6863-49af-ac52-64256277f0a9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:39.758823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:39.766791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 875/1751] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:39.840140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 877/1752] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:39.844381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172340-6b44-435f-96d2-fffdf425b106 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:39.871365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172340-6b44-435f-96d2-fffdf425b106 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:39.890466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0c6a-4cd9-4baa-ab9d-91b87b0f1111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:39.891482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0c6a-4cd9-4baa-ab9d-91b87b0f1111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:39.891482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0c6a-4cd9-4baa-ab9d-91b87b0f1111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:39.891816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0c6a-4cd9-4baa-ab9d-91b87b0f1111 admin admin] PATH_INFO: `/v3/projects/65c26b5462534b7f8672d8dbd516a3fb/users/f1a839ce43214adeb329ec379bf52a59/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:39.951536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e0c6a-4cd9-4baa-ab9d-91b87b0f1111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c26b5462534b7f8672d8dbd516a3fb, user_id=f1a839ce43214adeb329ec379bf52a59, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:39.958829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e0c6a-4cd9-4baa-ab9d-91b87b0f1111 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:40.012955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 876/1753] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:39 2022] PUT /identity/v3/projects/65c26b5462534b7f8672d8dbd516a3fb/users/f1a839ce43214adeb329ec379bf52a59/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:40.024056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df685c-643c-41c2-82b4-88ab44338f8c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:40.024986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df685c-643c-41c2-82b4-88ab44338f8c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:40.025553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df685c-643c-41c2-82b4-88ab44338f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:40.130427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-96df685c-643c-41c2-82b4-88ab44338f8c None None] MFA Rules not processed for user `f1a839ce43214adeb329ec379bf52a59`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:40.140022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-96df685c-643c-41c2-82b4-88ab44338f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:40.352104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 878/1754] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:40.372584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0c6a-4cd9-4baa-ab9d-91b87b0f1111 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:40.516141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0c6a-4cd9-4baa-ab9d-91b87b0f1111 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:40.535143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b96c7-e06e-413f-ac94-14e4078f01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:40.535901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b96c7-e06e-413f-ac94-14e4078f01f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:40.536249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b96c7-e06e-413f-ac94-14e4078f01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:40.536610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b96c7-e06e-413f-ac94-14e4078f01f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:40.537287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b96c7-e06e-413f-ac94-14e4078f01f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:40.539902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b96c7-e06e-413f-ac94-14e4078f01f5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:40.578039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df685c-643c-41c2-82b4-88ab44338f8c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:40.580244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-96df685c-643c-41c2-82b4-88ab44338f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:40.619188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 877/1755] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:40 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:40.621557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b96c7-e06e-413f-ac94-14e4078f01f5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:40.621816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df685c-643c-41c2-82b4-88ab44338f8c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:40.786668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:40.807033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:40.808795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:40.809083 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:40.809367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] PATH_INFO: `/v3/projects/2108eaadfe714bedbda9ed9cbeef67dc` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:40.812459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2108eaadfe714bedbda9ed9cbeef67dc)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:40.815275 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:40.818077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b96c7-e06e-413f-ac94-14e4078f01f5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:40.849931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad42c18-750f-4195-9529-e81fdb1d67d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:40.850808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad42c18-750f-4195-9529-e81fdb1d67d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:40.851298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad42c18-750f-4195-9529-e81fdb1d67d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:40.852117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad42c18-750f-4195-9529-e81fdb1d67d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:40.852597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad42c18-750f-4195-9529-e81fdb1d67d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:40.854860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad42c18-750f-4195-9529-e81fdb1d67d8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:40.891980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 878/1756] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:40 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:40.893015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad42c18-750f-4195-9529-e81fdb1d67d8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:40.916987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad42c18-750f-4195-9529-e81fdb1d67d8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:40.951897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2108eaadfe714bedbda9ed9cbeef67dc', 'request_id': 'req-ec75054e-1c87-4ea4-971e-2e8136e620cc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:40.985302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2108eaadfe714bedbda9ed9cbeef67dc', 'request_id': 'req-ec75054e-1c87-4ea4-971e-2e8136e620cc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.010189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2108eaadfe714bedbda9ed9cbeef67dc', 'request_id': 'req-ec75054e-1c87-4ea4-971e-2e8136e620cc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.045274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] The token cache is being invalidate because project 2108eaadfe714bedbda9ed9cbeef67dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:41.046305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.048216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.051464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 879/1757] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:40 2022] DELETE /identity/v3/projects/2108eaadfe714bedbda9ed9cbeef67dc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:41.052595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:41.055288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:41.084161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:41.122295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6a349-9fbe-433d-b37e-85d011f6706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:41.123038 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a349-9fbe-433d-b37e-85d011f6706e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:41.126982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a349-9fbe-433d-b37e-85d011f6706e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:41.129602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a349-9fbe-433d-b37e-85d011f6706e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:41.132766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6a349-9fbe-433d-b37e-85d011f6706e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:41.135143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6a349-9fbe-433d-b37e-85d011f6706e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:41.165977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75054e-1c87-4ea4-971e-2e8136e620cc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:41.172963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:41.186689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:41.187186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:41.187627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] PATH_INFO: `/v3/projects/26efb64d2b09474b85da75d9f5c6df35` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:41.190091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26efb64d2b09474b85da75d9f5c6df35)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:41.193587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:41.194916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 879/1758] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:41.201363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807d798-4f44-40a2-9ff0-c555a1d30a9f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:41.203313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807d798-4f44-40a2-9ff0-c555a1d30a9f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:41.203770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807d798-4f44-40a2-9ff0-c555a1d30a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:41.254069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7807d798-4f44-40a2-9ff0-c555a1d30a9f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:41.255758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7807d798-4f44-40a2-9ff0-c555a1d30a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:41.284911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 880/1759] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:41.284911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807d798-4f44-40a2-9ff0-c555a1d30a9f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:41.287060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7807d798-4f44-40a2-9ff0-c555a1d30a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:41.312799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807d798-4f44-40a2-9ff0-c555a1d30a9f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:41.351531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26efb64d2b09474b85da75d9f5c6df35', 'request_id': 'req-9b71119a-5ec0-4969-9107-562ff9d5aa54'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.371754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26efb64d2b09474b85da75d9f5c6df35', 'request_id': 'req-9b71119a-5ec0-4969-9107-562ff9d5aa54'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.393969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26efb64d2b09474b85da75d9f5c6df35', 'request_id': 'req-9b71119a-5ec0-4969-9107-562ff9d5aa54'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.407044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:41.408222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:41.408765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:41.409230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] PATH_INFO: `/v3/projects/bc4c1370aa86463dbf38142d936398fd/users/06d7b0518e714d5284eb8d4c12660469/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:41.431167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] The token cache is being invalidate because project 26efb64d2b09474b85da75d9f5c6df35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:41.431474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.434948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9b71119a-5ec0-4969-9107-562ff9d5aa54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.438250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 880/1760] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:41 2022] DELETE /identity/v3/projects/26efb64d2b09474b85da75d9f5c6df35 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:41.441530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7da456-61be-412f-873b-30a0fefd3329 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:41.441878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7da456-61be-412f-873b-30a0fefd3329 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:41.442084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7da456-61be-412f-873b-30a0fefd3329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:41.461080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4c1370aa86463dbf38142d936398fd, user_id=06d7b0518e714d5284eb8d4c12660469, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:41.469078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:41.490605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3d7da456-61be-412f-873b-30a0fefd3329 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:41.491874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3d7da456-61be-412f-873b-30a0fefd3329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:41.508171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 881/1761] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:41 2022] PUT /identity/v3/projects/bc4c1370aa86463dbf38142d936398fd/users/06d7b0518e714d5284eb8d4c12660469/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:41.508171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:41.509003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:41.670655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:41.726398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 881/1762] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:41.729975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7da456-61be-412f-873b-30a0fefd3329 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:41.745027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97124495-9c33-4547-90e3-23e4dbea7b18 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:41.751269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3d7da456-61be-412f-873b-30a0fefd3329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:41.764716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:41.765390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:41.765701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:41.767202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] PATH_INFO: `/v3/users/d5abe703b5bc4d1296b7e13cf134fbc9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:41.770996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5abe703b5bc4d1296b7e13cf134fbc9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:41.775459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:41.791572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7da456-61be-412f-873b-30a0fefd3329 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:41.807200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e108242-a2d5-44b8-804b-16e5459b9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:41.807945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e108242-a2d5-44b8-804b-16e5459b9f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:41.808871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e108242-a2d5-44b8-804b-16e5459b9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:41.809248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e108242-a2d5-44b8-804b-16e5459b9f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:41.810065 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e108242-a2d5-44b8-804b-16e5459b9f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:41.818240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e108242-a2d5-44b8-804b-16e5459b9f7a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:41.878041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 882/1763] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:41.879998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc114cfa-af9e-4bd0-a6bd-8dbda9adabdc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:41.881702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc114cfa-af9e-4bd0-a6bd-8dbda9adabdc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:41.882096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc114cfa-af9e-4bd0-a6bd-8dbda9adabdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:41.928299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5abe703b5bc4d1296b7e13cf134fbc9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:41.982806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bc114cfa-af9e-4bd0-a6bd-8dbda9adabdc None None] MFA Rules not processed for user `b657cf5dbf394b9db923082f00565a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:41.984161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bc114cfa-af9e-4bd0-a6bd-8dbda9adabdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:41.989925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5abe703b5bc4d1296b7e13cf134fbc9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:42.008073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5abe703b5bc4d1296b7e13cf134fbc9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:42.008893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5abe703b5bc4d1296b7e13cf134fbc9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:42.032568 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5abe703b5bc4d1296b7e13cf134fbc9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:42.046520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:42.057921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 882/1764] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:41 2022] DELETE /identity/v3/users/d5abe703b5bc4d1296b7e13cf134fbc9 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:42.090077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:42.092565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:42.163438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 883/1765] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:42.164644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc114cfa-af9e-4bd0-a6bd-8dbda9adabdc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:42.174362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bc114cfa-af9e-4bd0-a6bd-8dbda9adabdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:42.196753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc114cfa-af9e-4bd0-a6bd-8dbda9adabdc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:42.284768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab90b5-8d9a-464a-95bc-9354bb2b0f50 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:42.299090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:42.300998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:42.301468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:42.301811 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:42.302723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:42.303042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:42.309128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:42.333243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1547b-01c6-484d-9beb-f0edbdada72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:42.334236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1547b-01c6-484d-9beb-f0edbdada72d admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:42.334630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1547b-01c6-484d-9beb-f0edbdada72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:42.335010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1547b-01c6-484d-9beb-f0edbdada72d admin admin] PATH_INFO: `/v3/projects/bc4c1370aa86463dbf38142d936398fd/users/06d7b0518e714d5284eb8d4c12660469/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:42.336097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 883/1766] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:42.337147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:42.340928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1547b-01c6-484d-9beb-f0edbdada72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4c1370aa86463dbf38142d936398fd, user_id=06d7b0518e714d5284eb8d4c12660469, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:42.342530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:42.343870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1547b-01c6-484d-9beb-f0edbdada72d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:42.376380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 884/1767] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:42 2022] PUT /identity/v3/projects/bc4c1370aa86463dbf38142d936398fd/users/06d7b0518e714d5284eb8d4c12660469/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:42.378503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7071-9ad4-4772-8930-d7729bf96cc6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:42.378503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7071-9ad4-4772-8930-d7729bf96cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:42.379855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7071-9ad4-4772-8930-d7729bf96cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:42.460033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-adeb7071-9ad4-4772-8930-d7729bf96cc6 None None] MFA Rules not processed for user `9684fc6cb8364623b9c418ab316dafeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:42.461363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-adeb7071-9ad4-4772-8930-d7729bf96cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:42.476936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:42.516589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba248-b41e-4a10-82ed-ffd84910f9a8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:42.668888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f669a-ffd0-46f4-b3f7-cf1e98a9f2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:42.669737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f669a-ffd0-46f4-b3f7-cf1e98a9f2ea service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:42.670096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f669a-ffd0-46f4-b3f7-cf1e98a9f2ea service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:42.670444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f669a-ffd0-46f4-b3f7-cf1e98a9f2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:42.699849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 885/1768] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:42.701338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7071-9ad4-4772-8930-d7729bf96cc6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:42.774534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f669a-ffd0-46f4-b3f7-cf1e98a9f2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:42.778507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f669a-ffd0-46f4-b3f7-cf1e98a9f2ea service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:42.801854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 884/1769] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:42.805151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536dcd-f98f-49a3-9e39-65a70643c006 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:42.805530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536dcd-f98f-49a3-9e39-65a70643c006 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:42.805874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a536dcd-f98f-49a3-9e39-65a70643c006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:42.840068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9a536dcd-f98f-49a3-9e39-65a70643c006 None None] MFA Rules not processed for user `06d7b0518e714d5284eb8d4c12660469`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:42.841771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a536dcd-f98f-49a3-9e39-65a70643c006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:43.020026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 885/1770] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:43.024927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6835b35-f191-424b-8c57-a855f704d11e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:43.027434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6835b35-f191-424b-8c57-a855f704d11e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:43.032130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6835b35-f191-424b-8c57-a855f704d11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:43.032353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:43.102707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e6835b35-f191-424b-8c57-a855f704d11e None None] MFA Rules not processed for user `9684fc6cb8364623b9c418ab316dafeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:43.106453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e6835b35-f191-424b-8c57-a855f704d11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:43.131106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7071-9ad4-4772-8930-d7729bf96cc6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:43.141788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 886/1771] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:43.141788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6835b35-f191-424b-8c57-a855f704d11e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:43.143548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e6835b35-f191-424b-8c57-a855f704d11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:43.173780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ed830-78a8-476a-8986-6976d6dfd5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:43.173780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ed830-78a8-476a-8986-6976d6dfd5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:43.173780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ed830-78a8-476a-8986-6976d6dfd5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:43.173780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ed830-78a8-476a-8986-6976d6dfd5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:43.180261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ed830-78a8-476a-8986-6976d6dfd5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:43.182697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ed830-78a8-476a-8986-6976d6dfd5c5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:43.211772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:43.294975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 886/1772] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:42 2022] POST /identity/v3/projects => generated 371 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:43.297326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ed830-78a8-476a-8986-6976d6dfd5c5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:43.340334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6835b35-f191-424b-8c57-a855f704d11e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:43.520649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:43.521276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:43.527991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:43.528592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:43.534312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:43.570396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ed830-78a8-476a-8986-6976d6dfd5c5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:43.598169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:43.598824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:43.599111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:43.599392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:43.707134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:43.708699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:43.752169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 887/1773] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:43.753070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:43.827672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:43.829188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:43.853523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 887/1774] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:43.854515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:43.867850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:43.991990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8a8be-c674-467a-a9c1-9f851b16f6c9 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:44.010290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab562a-0adb-4a44-a00f-fafde4fe3935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:44.010946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab562a-0adb-4a44-a00f-fafde4fe3935 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.011304 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab562a-0adb-4a44-a00f-fafde4fe3935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.011590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab562a-0adb-4a44-a00f-fafde4fe3935 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.012272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab562a-0adb-4a44-a00f-fafde4fe3935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:44.014300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab562a-0adb-4a44-a00f-fafde4fe3935 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:44.082538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 888/1775] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:43 2022] POST /identity/v3/users => generated 286 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:44.090147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ec220-5617-4149-baf8-bbce884b6b7b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.090500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ec220-5617-4149-baf8-bbce884b6b7b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.090781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ec220-5617-4149-baf8-bbce884b6b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.149774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:44.154649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc37ee-363f-4e43-a063-b5628c3b2ca0 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:44.172468 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:44.172933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.173137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.173432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] PATH_INFO: `/v3/projects/65e67ab9799d40c88c5d7325070dac8b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.176785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e67ab9799d40c88c5d7325070dac8b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:44.180756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:44.220444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:44.240603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-c60ec220-5617-4149-baf8-bbce884b6b7b None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:44.242069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c60ec220-5617-4149-baf8-bbce884b6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:44.333318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e67ab9799d40c88c5d7325070dac8b', 'request_id': 'req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:44.363437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e67ab9799d40c88c5d7325070dac8b', 'request_id': 'req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:44.393782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e67ab9799d40c88c5d7325070dac8b', 'request_id': 'req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:44.430982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] The token cache is being invalidate because project 65e67ab9799d40c88c5d7325070dac8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:44.431455 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:44.433093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:44.444073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 888/1776] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:43 2022] DELETE /identity/v3/projects/65e67ab9799d40c88c5d7325070dac8b => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:44.444838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:44.450624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:44.473557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 889/1777] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:44.477376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cbfe0-d865-4e79-9200-4d8cb669c4d9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.477647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cbfe0-d865-4e79-9200-4d8cb669c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.478026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cbfe0-d865-4e79-9200-4d8cb669c4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.569654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-569cbfe0-d865-4e79-9200-4d8cb669c4d9 None None] MFA Rules not processed for user `5cea7737368147a78c91fd4b89139ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:44.575089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-569cbfe0-d865-4e79-9200-4d8cb669c4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:44.704977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3937d-4085-48b5-8fb4-3364e5dbd4e4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:44.722673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc0e32-1158-4911-a54d-0636709224f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:44.726244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc0e32-1158-4911-a54d-0636709224f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.727732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc0e32-1158-4911-a54d-0636709224f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.728688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc0e32-1158-4911-a54d-0636709224f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.730823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 890/1778] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:44.730978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc0e32-1158-4911-a54d-0636709224f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:44.732675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f252b-7299-4fff-ba71-7b11ed992d94 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.732982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f252b-7299-4fff-ba71-7b11ed992d94 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.733260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f252b-7299-4fff-ba71-7b11ed992d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.735165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc0e32-1158-4911-a54d-0636709224f9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:44.759269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 889/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:44.761795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd91a-1528-4995-bea7-a388735dc885 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.778501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd91a-1528-4995-bea7-a388735dc885 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.778984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddd91a-1528-4995-bea7-a388735dc885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.785374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-712f252b-7299-4fff-ba71-7b11ed992d94 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:44.786664 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-712f252b-7299-4fff-ba71-7b11ed992d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:44.805082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-aaddd91a-1528-4995-bea7-a388735dc885 None None] MFA Rules not processed for user `5cea7737368147a78c91fd4b89139ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:44.806883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aaddd91a-1528-4995-bea7-a388735dc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:44.814381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 891/1780] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:44.814381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f252b-7299-4fff-ba71-7b11ed992d94 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:44.830857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 890/1781] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:44.832175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddd91a-1528-4995-bea7-a388735dc885 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:44.834941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aaddd91a-1528-4995-bea7-a388735dc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:44.854491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f252b-7299-4fff-ba71-7b11ed992d94 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:44.872068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d608708-7f2d-43e0-ae91-e18a59c9b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:44.874034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608708-7f2d-43e0-ae91-e18a59c9b2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.877575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608708-7f2d-43e0-ae91-e18a59c9b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.878973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d608708-7f2d-43e0-ae91-e18a59c9b2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.880297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d608708-7f2d-43e0-ae91-e18a59c9b2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:44.884556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d608708-7f2d-43e0-ae91-e18a59c9b2b6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:44.916813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 892/1782] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:44.922121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca421-057e-4d2e-995b-2eb2586059fc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:44.923124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca421-057e-4d2e-995b-2eb2586059fc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:44.924515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ca421-057e-4d2e-995b-2eb2586059fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:44.976849 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-978ca421-057e-4d2e-995b-2eb2586059fc None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:44.978139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-978ca421-057e-4d2e-995b-2eb2586059fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:45.032973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 893/1783] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:45.035134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ca421-057e-4d2e-995b-2eb2586059fc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:45.086144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ca421-057e-4d2e-995b-2eb2586059fc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:45.100746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:45.101491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:45.101785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:45.102059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] PATH_INFO: `/v3/projects/edee97a2f04a4e3c892b6b3f257eedfd/users/98f61652fb5b4b87a1cad5c6fcf0cf9e/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:45.130409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddd91a-1528-4995-bea7-a388735dc885 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:45.137545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edee97a2f04a4e3c892b6b3f257eedfd, user_id=98f61652fb5b4b87a1cad5c6fcf0cf9e, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:45.140541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:45.141341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:45.142324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:45.142617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:45.146361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:45.150751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:45.174856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:45.206376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 894/1784] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:45 2022] PUT /identity/v3/projects/edee97a2f04a4e3c892b6b3f257eedfd/users/98f61652fb5b4b87a1cad5c6fcf0cf9e/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:45.207717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:45.217385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:45.304427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:45.328516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:45.331515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:45.355685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 891/1785] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:13:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:13:45.357972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:45.404355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d64c4-b2e6-4ae5-8903-b3a5d02b1ecb service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:45.434617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8641b-7b00-4a18-b79c-8f81c0763a28 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:45.461481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5db4-a0ff-4632-a291-1c4dbe58db08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:45.462139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5db4-a0ff-4632-a291-1c4dbe58db08 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:45.462686 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5db4-a0ff-4632-a291-1c4dbe58db08 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:45.462974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c5db4-a0ff-4632-a291-1c4dbe58db08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:45.627807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892fca4-4c96-4b73-b522-feb5a6502d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:45.629542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fca4-4c96-4b73-b522-feb5a6502d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:45.629975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fca4-4c96-4b73-b522-feb5a6502d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:45.630472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892fca4-4c96-4b73-b522-feb5a6502d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:45.631436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892fca4-4c96-4b73-b522-feb5a6502d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:45.631890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892fca4-4c96-4b73-b522-feb5a6502d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:45.634799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892fca4-4c96-4b73-b522-feb5a6502d0c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:45.657767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c5db4-a0ff-4632-a291-1c4dbe58db08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:45.659645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c5db4-a0ff-4632-a291-1c4dbe58db08 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:45.670685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 892/1786] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:45.674218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63506b-5ea3-4720-a6eb-1be0150a7531 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:45.674965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63506b-5ea3-4720-a6eb-1be0150a7531 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:45.675860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63506b-5ea3-4720-a6eb-1be0150a7531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:45.686398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 895/1787] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:45.687258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5db4-a0ff-4632-a291-1c4dbe58db08 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:45.730194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c5db4-a0ff-4632-a291-1c4dbe58db08 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:45.754523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-be63506b-5ea3-4720-a6eb-1be0150a7531 None None] MFA Rules not processed for user `98f61652fb5b4b87a1cad5c6fcf0cf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:45.757531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-be63506b-5ea3-4720-a6eb-1be0150a7531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:45.762032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:45.763099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:45.764006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:45.764297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:45.765507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:45.767539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:45.893192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 896/1788] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:45 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:45.898718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:45.910010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:46.027732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 893/1789] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:46.028704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63506b-5ea3-4720-a6eb-1be0150a7531 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:46.059216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd932f-6d3e-40ca-b644-8cbf84b6b35f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:46.064113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:46.065084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:46.065286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:46.065911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:46.067293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63506b-5ea3-4720-a6eb-1be0150a7531 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:46.068339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:46.192861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:46.225887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:46.237480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:46.239882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:46.272265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793eae7-115c-4b68-8495-542b4221e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:46.272895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793eae7-115c-4b68-8495-542b4221e374 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:46.273186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793eae7-115c-4b68-8495-542b4221e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:46.273479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793eae7-115c-4b68-8495-542b4221e374 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:46.274134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793eae7-115c-4b68-8495-542b4221e374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:46.276084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793eae7-115c-4b68-8495-542b4221e374 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:46.278003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 897/1790] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:46.279096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:46.301740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dee72-9d89-430b-b7ed-4f0055851020 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:46.323169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fd9af-01a5-44bf-859b-c42d73e3b0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:46.323900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd9af-01a5-44bf-859b-c42d73e3b0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:46.324163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd9af-01a5-44bf-859b-c42d73e3b0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:46.324425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd9af-01a5-44bf-859b-c42d73e3b0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:46.325292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fd9af-01a5-44bf-859b-c42d73e3b0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:46.327530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fd9af-01a5-44bf-859b-c42d73e3b0f5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:46.363623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 894/1791] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:46 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:46.365109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793eae7-115c-4b68-8495-542b4221e374 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:46.393076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 898/1792] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:46 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:46.398229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fd9af-01a5-44bf-859b-c42d73e3b0f5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:46.398754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793eae7-115c-4b68-8495-542b4221e374 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:46.681585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fd9af-01a5-44bf-859b-c42d73e3b0f5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:46.723045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020d789-a8c0-4663-a2a6-f5467b043e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:46.724065 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020d789-a8c0-4663-a2a6-f5467b043e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:46.726177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312f37f-a40f-4e84-bc60-0b960048e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:46.726689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020d789-a8c0-4663-a2a6-f5467b043e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:46.726797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f37f-a40f-4e84-bc60-0b960048e90c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:46.727092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f37f-a40f-4e84-bc60-0b960048e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:46.727371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f37f-a40f-4e84-bc60-0b960048e90c admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:46.728024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312f37f-a40f-4e84-bc60-0b960048e90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:46.728290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020d789-a8c0-4663-a2a6-f5467b043e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:46.729125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020d789-a8c0-4663-a2a6-f5467b043e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:46.730749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312f37f-a40f-4e84-bc60-0b960048e90c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:46.737653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020d789-a8c0-4663-a2a6-f5467b043e22 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:46.791134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 895/1793] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:46.801812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020d789-a8c0-4663-a2a6-f5467b043e22 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:46.804015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 899/1794] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:46 2022] POST /identity/v3/users => generated 292 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:46.809342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312f37f-a40f-4e84-bc60-0b960048e90c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:46.849109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020d789-a8c0-4663-a2a6-f5467b043e22 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:46.861106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312f37f-a40f-4e84-bc60-0b960048e90c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:46.874558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28753d-f460-44d7-a5be-7780f63644ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:46.878026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7de126-e85f-4fc3-9d7f-7abe420a0b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:46.878199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28753d-f460-44d7-a5be-7780f63644ff admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:46.878424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28753d-f460-44d7-a5be-7780f63644ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:46.878690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28753d-f460-44d7-a5be-7780f63644ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:46.881599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28753d-f460-44d7-a5be-7780f63644ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:46.885454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7de126-e85f-4fc3-9d7f-7abe420a0b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:46.885454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7de126-e85f-4fc3-9d7f-7abe420a0b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:46.885454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7de126-e85f-4fc3-9d7f-7abe420a0b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:46.887439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28753d-f460-44d7-a5be-7780f63644ff admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:46.891878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7de126-e85f-4fc3-9d7f-7abe420a0b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:46.899357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7de126-e85f-4fc3-9d7f-7abe420a0b22 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:46.949024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 900/1795] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:46.954038 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7de126-e85f-4fc3-9d7f-7abe420a0b22 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:46.966840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 896/1796] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:46.969726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28753d-f460-44d7-a5be-7780f63644ff admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:47.010628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7de126-e85f-4fc3-9d7f-7abe420a0b22 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:47.027905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28753d-f460-44d7-a5be-7780f63644ff admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:47.041250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc989-d318-4deb-8c11-bcfd2323e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:47.042752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc989-d318-4deb-8c11-bcfd2323e525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:47.046702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc989-d318-4deb-8c11-bcfd2323e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:47.047176 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dc989-d318-4deb-8c11-bcfd2323e525 admin admin] PATH_INFO: `/v3/projects/765944e5e0074635a93d457a9e0f95ce/users/86a7c3eacb1242f68c4671b878b96849/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:47.048894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:47.049736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:47.050024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:47.050306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] PATH_INFO: `/v3/projects/2043abb36c9e4861824d2b961a27661a/users/3c4b37da792b4a9aaf7a66ad0d617a1b/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:47.118434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dc989-d318-4deb-8c11-bcfd2323e525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765944e5e0074635a93d457a9e0f95ce, user_id=86a7c3eacb1242f68c4671b878b96849, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:47.121121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2043abb36c9e4861824d2b961a27661a, user_id=3c4b37da792b4a9aaf7a66ad0d617a1b, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:47.124010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:47.125746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dc989-d318-4deb-8c11-bcfd2323e525 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:47.189809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 901/1797] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:46 2022] PUT /identity/v3/projects/2043abb36c9e4861824d2b961a27661a/users/3c4b37da792b4a9aaf7a66ad0d617a1b/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:47.191744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:47.218898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 897/1798] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:46 2022] PUT /identity/v3/projects/765944e5e0074635a93d457a9e0f95ce/users/86a7c3eacb1242f68c4671b878b96849/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:47.220891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc989-d318-4deb-8c11-bcfd2323e525 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:47.238421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:47.443723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f591d9-1056-4505-b758-a4ab8edb3f84 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:47.462109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:47.463516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:47.465874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:47.466241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] PATH_INFO: `/v3/users/be58ea44b3c04667821fe50d668aa5a7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:47.468660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be58ea44b3c04667821fe50d668aa5a7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:47.474362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:47.547872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:47.609058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be58ea44b3c04667821fe50d668aa5a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:47.636658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dc989-d318-4deb-8c11-bcfd2323e525 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:47.637532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be58ea44b3c04667821fe50d668aa5a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:47.656155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be58ea44b3c04667821fe50d668aa5a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:47.656881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be58ea44b3c04667821fe50d668aa5a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:47.667115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3e15a692-4fec-49b3-a9d7-31482305a9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be58ea44b3c04667821fe50d668aa5a7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:47.670822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391da6b-1c23-4b4f-83f0-33ce6c1dc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:47.671469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391da6b-1c23-4b4f-83f0-33ce6c1dc2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:47.671746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391da6b-1c23-4b4f-83f0-33ce6c1dc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:47.672021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391da6b-1c23-4b4f-83f0-33ce6c1dc2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:47.672691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391da6b-1c23-4b4f-83f0-33ce6c1dc2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:47.678213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 902/1799] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:47 2022] DELETE /identity/v3/users/be58ea44b3c04667821fe50d668aa5a7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:47.678213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fd4f-5d7e-4a72-88e7-3998315fa24e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:47.678959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fd4f-5d7e-4a72-88e7-3998315fa24e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:47.678959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fd4f-5d7e-4a72-88e7-3998315fa24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:47.685246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391da6b-1c23-4b4f-83f0-33ce6c1dc2a7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:47.740437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0ab6fd4f-5d7e-4a72-88e7-3998315fa24e None None] MFA Rules not processed for user `86a7c3eacb1242f68c4671b878b96849`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:47.743072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0ab6fd4f-5d7e-4a72-88e7-3998315fa24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:47.752199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 898/1800] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:47.758135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d6cd-dd11-431e-9f8d-65937c05ce2d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:47.758443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d6cd-dd11-431e-9f8d-65937c05ce2d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:47.758726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d6cd-dd11-431e-9f8d-65937c05ce2d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:47.777385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 899/1801] 10.222.0.20 () {54 vars in 912 bytes} [Thu Sep 8 01:13:47 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:13:47.778965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec382-bad0-47c3-8e5f-ac6ebcf34944 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:47.779252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec382-bad0-47c3-8e5f-ac6ebcf34944 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:47.779528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec382-bad0-47c3-8e5f-ac6ebcf34944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:47.856779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cc1ec382-bad0-47c3-8e5f-ac6ebcf34944 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:47.861620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cc1ec382-bad0-47c3-8e5f-ac6ebcf34944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:47.939890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:47.943031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 903/1802] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:47.943951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6fd4f-5d7e-4a72-88e7-3998315fa24e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:47.953814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0ab6fd4f-5d7e-4a72-88e7-3998315fa24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:48.127733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6fd4f-5d7e-4a72-88e7-3998315fa24e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:48.152481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 900/1803] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:48.157349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf07c1d-05df-4d78-bd8d-b80bdc629dd5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:48.157562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:48.157684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf07c1d-05df-4d78-bd8d-b80bdc629dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:48.157928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf07c1d-05df-4d78-bd8d-b80bdc629dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:48.161792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:48.164650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:48.167993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] PATH_INFO: `/v3/projects/2043abb36c9e4861824d2b961a27661a/users/3c4b37da792b4a9aaf7a66ad0d617a1b/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:48.178981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2043abb36c9e4861824d2b961a27661a, user_id=3c4b37da792b4a9aaf7a66ad0d617a1b, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:48.191882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:48.242531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7bf07c1d-05df-4d78-bd8d-b80bdc629dd5 None None] MFA Rules not processed for user `5a6ff1b9371a411bae7b3e45f78e05e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:48.252674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7bf07c1d-05df-4d78-bd8d-b80bdc629dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:48.305252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 904/1804] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:47 2022] PUT /identity/v3/projects/2043abb36c9e4861824d2b961a27661a/users/3c4b37da792b4a9aaf7a66ad0d617a1b/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:48.305252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:48.317188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:48.451975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:48.502769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 901/1805] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:48.503897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0e9e8-e42f-4210-ac02-297046db50a4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:48.504438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0e9e8-e42f-4210-ac02-297046db50a4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:48.504723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0e9e8-e42f-4210-ac02-297046db50a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:48.595689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-04f0e9e8-e42f-4210-ac02-297046db50a4 None None] MFA Rules not processed for user `9684fc6cb8364623b9c418ab316dafeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:48.596879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-04f0e9e8-e42f-4210-ac02-297046db50a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:48.598927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ab0a8-672e-4aa4-a523-05bf248f5593 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:48.630504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:48.631583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:48.632142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:48.632704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:48.633648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:48.637687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:48.706072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 905/1806] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:48 2022] POST /identity/v3/projects => generated 389 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:48.707458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:48.721073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:48.836676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 902/1807] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:48.838109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92309df9-105c-4bf3-946e-e9d67ae90d33 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:48.838521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92309df9-105c-4bf3-946e-e9d67ae90d33 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:48.838829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92309df9-105c-4bf3-946e-e9d67ae90d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:48.912897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-92309df9-105c-4bf3-946e-e9d67ae90d33 None None] MFA Rules not processed for user `3c4b37da792b4a9aaf7a66ad0d617a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:48.914215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-92309df9-105c-4bf3-946e-e9d67ae90d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:48.956950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4c695-c24f-4e24-8317-80506d6897d8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:48.981134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8c2f4-cce7-4a02-a824-08a3d5f00b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:48.981799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8c2f4-cce7-4a02-a824-08a3d5f00b7e service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:48.982091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8c2f4-cce7-4a02-a824-08a3d5f00b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:48.982370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8c2f4-cce7-4a02-a824-08a3d5f00b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.096769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 903/1808] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:49.098744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eaf0f-bdfe-4842-b8c8-7f36dc873988 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:49.099246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eaf0f-bdfe-4842-b8c8-7f36dc873988 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:49.099528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eaf0f-bdfe-4842-b8c8-7f36dc873988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.124654 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:49.158881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d54eaf0f-bdfe-4842-b8c8-7f36dc873988 None None] MFA Rules not processed for user `5a6ff1b9371a411bae7b3e45f78e05e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:49.161117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d54eaf0f-bdfe-4842-b8c8-7f36dc873988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:49.184931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 904/1809] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 8 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:49.190160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eaf0f-bdfe-4842-b8c8-7f36dc873988 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:49.216375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eaf0f-bdfe-4842-b8c8-7f36dc873988 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:49.220558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8c2f4-cce7-4a02-a824-08a3d5f00b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:49.222229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8c2f4-cce7-4a02-a824-08a3d5f00b7e service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:49.230428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:49.231579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:49.231908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:49.232279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.248643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 906/1810] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:49.265393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:49.268834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8c2f4-cce7-4a02-a824-08a3d5f00b7e service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:49.269936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:49.301734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8c2f4-cce7-4a02-a824-08a3d5f00b7e service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:49.305780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 905/1811] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:49.307265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:49.310095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:49.316792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047755b-1b78-4a84-8a1a-13284191b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:49.319741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047755b-1b78-4a84-8a1a-13284191b07a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:49.320044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047755b-1b78-4a84-8a1a-13284191b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:49.320319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047755b-1b78-4a84-8a1a-13284191b07a admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.321024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047755b-1b78-4a84-8a1a-13284191b07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:49.324450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047755b-1b78-4a84-8a1a-13284191b07a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:49.388150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 907/1812] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:49 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:49.390127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047755b-1b78-4a84-8a1a-13284191b07a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:49.417599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047755b-1b78-4a84-8a1a-13284191b07a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:49.429812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366f08-8742-47bb-b0c1-67da9cc66d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:49.431938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366f08-8742-47bb-b0c1-67da9cc66d14 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:49.432182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366f08-8742-47bb-b0c1-67da9cc66d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:49.432533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366f08-8742-47bb-b0c1-67da9cc66d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.455950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a366f08-8742-47bb-b0c1-67da9cc66d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:49.459549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a366f08-8742-47bb-b0c1-67da9cc66d14 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:49.474172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a527278-73c9-4e27-803c-d5c3d3e80aa8 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:49.482968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 908/1813] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:49.485483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366f08-8742-47bb-b0c1-67da9cc66d14 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:49.486291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007a0db-163c-40b8-a4b9-3cfb529e29e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:49.487106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a0db-163c-40b8-a4b9-3cfb529e29e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:49.488752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a0db-163c-40b8-a4b9-3cfb529e29e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:49.489119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a0db-163c-40b8-a4b9-3cfb529e29e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.521336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366f08-8742-47bb-b0c1-67da9cc66d14 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:49.525105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007a0db-163c-40b8-a4b9-3cfb529e29e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:49.530550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007a0db-163c-40b8-a4b9-3cfb529e29e2 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:49.546358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37874f-ea5e-43dc-b445-7fa9bbb0d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:49.546984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37874f-ea5e-43dc-b445-7fa9bbb0d60e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:49.547269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37874f-ea5e-43dc-b445-7fa9bbb0d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:49.547536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37874f-ea5e-43dc-b445-7fa9bbb0d60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.548819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37874f-ea5e-43dc-b445-7fa9bbb0d60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:49.552048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37874f-ea5e-43dc-b445-7fa9bbb0d60e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:49.593487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 906/1814] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:49.595451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089226e5-e6b8-4d5e-8e98-3abb350a132a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:49.595779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089226e5-e6b8-4d5e-8e98-3abb350a132a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:49.596078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089226e5-e6b8-4d5e-8e98-3abb350a132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.625184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 909/1815] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:49.636992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37874f-ea5e-43dc-b445-7fa9bbb0d60e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:49.680159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37874f-ea5e-43dc-b445-7fa9bbb0d60e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:49.702243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-089226e5-e6b8-4d5e-8e98-3abb350a132a None None] MFA Rules not processed for user `b657cf5dbf394b9db923082f00565a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:49.707034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-089226e5-e6b8-4d5e-8e98-3abb350a132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:49.722517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f195b16-0748-4021-8ac0-4a6410ba6275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:49.723398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f195b16-0748-4021-8ac0-4a6410ba6275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:49.730287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f195b16-0748-4021-8ac0-4a6410ba6275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:49.730749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f195b16-0748-4021-8ac0-4a6410ba6275 admin admin] PATH_INFO: `/v3/projects/a891501e387e4483be7ad07ca322c325/users/2e2af0cc2b3d4f0c95a5860be3d393da/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:49.816331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f195b16-0748-4021-8ac0-4a6410ba6275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a891501e387e4483be7ad07ca322c325, user_id=2e2af0cc2b3d4f0c95a5860be3d393da, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:49.819258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f195b16-0748-4021-8ac0-4a6410ba6275 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:49.845524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:49.854005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 910/1816] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:49 2022] PUT /identity/v3/projects/a891501e387e4483be7ad07ca322c325/users/2e2af0cc2b3d4f0c95a5860be3d393da/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:49.855727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f195b16-0748-4021-8ac0-4a6410ba6275 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:50.042633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 907/1817] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:50.045008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089226e5-e6b8-4d5e-8e98-3abb350a132a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:50.080658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089226e5-e6b8-4d5e-8e98-3abb350a132a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:50.084872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f195b16-0748-4021-8ac0-4a6410ba6275 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:50.093537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc062b-7e09-49fe-808d-c55082808742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:50.094207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc062b-7e09-49fe-808d-c55082808742 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:50.094593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc062b-7e09-49fe-808d-c55082808742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:50.094880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc062b-7e09-49fe-808d-c55082808742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:50.095755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc062b-7e09-49fe-808d-c55082808742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:50.097728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc062b-7e09-49fe-808d-c55082808742 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:50.134456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 911/1818] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:13:50.135740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc062b-7e09-49fe-808d-c55082808742 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:50.163297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc062b-7e09-49fe-808d-c55082808742 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:50.176633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff18e8-d52a-4ae7-903f-62655f7089aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:50.178321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff18e8-d52a-4ae7-903f-62655f7089aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:50.178728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff18e8-d52a-4ae7-903f-62655f7089aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:50.179413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff18e8-d52a-4ae7-903f-62655f7089aa admin admin] PATH_INFO: `/v3/projects/a891501e387e4483be7ad07ca322c325/users/2e2af0cc2b3d4f0c95a5860be3d393da/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:50.182138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff18e8-d52a-4ae7-903f-62655f7089aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a891501e387e4483be7ad07ca322c325, user_id=2e2af0cc2b3d4f0c95a5860be3d393da, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:50.186738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff18e8-d52a-4ae7-903f-62655f7089aa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:50.213117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 912/1819] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:50 2022] PUT /identity/v3/projects/a891501e387e4483be7ad07ca322c325/users/2e2af0cc2b3d4f0c95a5860be3d393da/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:50.215274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19718e16-2d77-4c94-a81d-43a5f3c03861 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:50.215632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19718e16-2d77-4c94-a81d-43a5f3c03861 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:50.216415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19718e16-2d77-4c94-a81d-43a5f3c03861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:50.251556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-19718e16-2d77-4c94-a81d-43a5f3c03861 None None] MFA Rules not processed for user `2e2af0cc2b3d4f0c95a5860be3d393da`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:50.252988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-19718e16-2d77-4c94-a81d-43a5f3c03861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:50.277978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:50.281291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:50.282525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:50.284684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:50.290304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:50.395267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 913/1820] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:50.396451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19718e16-2d77-4c94-a81d-43a5f3c03861 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:50.398595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-19718e16-2d77-4c94-a81d-43a5f3c03861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:50.398999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:50.422729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:50.424581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:50.437698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 908/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:50.518971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19718e16-2d77-4c94-a81d-43a5f3c03861 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:50.523956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:50.524872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:50.525337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:50.526023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:50.542936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:50.544836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:50.580220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 914/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:50.882194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:50.906854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9a3e-6b1f-4966-bd71-3b0112633869 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:51.091668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:51.094340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:51.114345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:51.116250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:51.116573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:51.116885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] PATH_INFO: `/v3/users/86a7c3eacb1242f68c4671b878b96849` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:51.120412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a7c3eacb1242f68c4671b878b96849)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:51.123192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:51.136272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:51.294463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d1a1b-dc52-41d3-815b-f6ab77426d16 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:51.302014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:51.303015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:51.303477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:51.304067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] PATH_INFO: `/v3/users/f1a839ce43214adeb329ec379bf52a59` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:51.305682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a839ce43214adeb329ec379bf52a59)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:51.309465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:51.339047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a7c3eacb1242f68c4671b878b96849'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.364856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a7c3eacb1242f68c4671b878b96849'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.404043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a7c3eacb1242f68c4671b878b96849'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.410369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a7c3eacb1242f68c4671b878b96849'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.447131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d3bb3bd2-8f98-4ac8-8194-db94d5277f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a7c3eacb1242f68c4671b878b96849'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.455229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a839ce43214adeb329ec379bf52a59'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.463113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 909/1823] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:50 2022] DELETE /identity/v3/users/86a7c3eacb1242f68c4671b878b96849 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:51.468962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9ab0-9e4b-4fed-9d2f-07f7aeda10e6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:51.469213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9ab0-9e4b-4fed-9d2f-07f7aeda10e6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:51.469521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9ab0-9e4b-4fed-9d2f-07f7aeda10e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:51.497892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a839ce43214adeb329ec379bf52a59'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.523552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-58fa9ab0-9e4b-4fed-9d2f-07f7aeda10e6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:51.526860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-58fa9ab0-9e4b-4fed-9d2f-07f7aeda10e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:51.532213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a839ce43214adeb329ec379bf52a59'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.533888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a839ce43214adeb329ec379bf52a59'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.578124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-038f5e79-2c6c-4635-9fdc-3153db1e8669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a839ce43214adeb329ec379bf52a59'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:51.592501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 915/1824] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:51 2022] DELETE /identity/v3/users/f1a839ce43214adeb329ec379bf52a59 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:51.606481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4d22f-6c6d-455f-97bc-137e3ac008e8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:51.606907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4d22f-6c6d-455f-97bc-137e3ac008e8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:51.607290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4d22f-6c6d-455f-97bc-137e3ac008e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:51.613752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 910/1825] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:13:51.662611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d5b4d22f-6c6d-455f-97bc-137e3ac008e8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:51.663865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5b4d22f-6c6d-455f-97bc-137e3ac008e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:51.676258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa9ab0-9e4b-4fed-9d2f-07f7aeda10e6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:51.678096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-58fa9ab0-9e4b-4fed-9d2f-07f7aeda10e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:51.687404 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:51.859588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 916/1826] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:13:51.896538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa9ab0-9e4b-4fed-9d2f-07f7aeda10e6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:51.918623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4d22f-6c6d-455f-97bc-137e3ac008e8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:51.921130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d5b4d22f-6c6d-455f-97bc-137e3ac008e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:52.017516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:52.111953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4d22f-6c6d-455f-97bc-137e3ac008e8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:52.113649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:52.115576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:52.116123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:52.119246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:52.132906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318758b-c7ca-4720-aa46-1a80c4052eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:52.133853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318758b-c7ca-4720-aa46-1a80c4052eae service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:52.135544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318758b-c7ca-4720-aa46-1a80c4052eae service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:52.136536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318758b-c7ca-4720-aa46-1a80c4052eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:52.163984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:52.167270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:52.175441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318758b-c7ca-4720-aa46-1a80c4052eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:52.176918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318758b-c7ca-4720-aa46-1a80c4052eae service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:52.199142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 911/1827] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:13:52.220981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 917/1828] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:13:52.425206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:52.428810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:52.460449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f241ab3-a378-4e97-913e-8795f178c2c9 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:52.479216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:52.480066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:52.480461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:52.480847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] PATH_INFO: `/v3/projects/24fc8ec2a7dc4971821f837bd7fcda20` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:52.484870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fc8ec2a7dc4971821f837bd7fcda20)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:52.494864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:52.767234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fc8ec2a7dc4971821f837bd7fcda20', 'request_id': 'req-c5471c59-90a8-46ef-a382-1a6d2a82d737'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:52.796467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fc8ec2a7dc4971821f837bd7fcda20', 'request_id': 'req-c5471c59-90a8-46ef-a382-1a6d2a82d737'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:52.842919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fc8ec2a7dc4971821f837bd7fcda20', 'request_id': 'req-c5471c59-90a8-46ef-a382-1a6d2a82d737'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:52.921061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] The token cache is being invalidate because project 24fc8ec2a7dc4971821f837bd7fcda20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:52.923607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:52.926142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:52.931629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 912/1829] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:52 2022] DELETE /identity/v3/projects/24fc8ec2a7dc4971821f837bd7fcda20 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:52.936238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318758b-c7ca-4720-aa46-1a80c4052eae service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:52.959938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318758b-c7ca-4720-aa46-1a80c4052eae service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:53.197766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:53.199193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:53.199602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:53.200233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] PATH_INFO: `/v3/users/1b70df25e80849fba31e3b648869749b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:53.202747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b70df25e80849fba31e3b648869749b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:53.206045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:53.305143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b70df25e80849fba31e3b648869749b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:53.325328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b70df25e80849fba31e3b648869749b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:53.341042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b70df25e80849fba31e3b648869749b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:53.343418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b70df25e80849fba31e3b648869749b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:53.378125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f6f9fa75-717b-4483-99a9-0994ad724f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b70df25e80849fba31e3b648869749b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:53.390966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 918/1830] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:52 2022] DELETE /identity/v3/users/1b70df25e80849fba31e3b648869749b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:53.946622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:53.948323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:53.972682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471c59-90a8-46ef-a382-1a6d2a82d737 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:54.132873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:54.196735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15ab5-f3a8-4534-8945-0a77fb395f05 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:54.197276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15ab5-f3a8-4534-8945-0a77fb395f05 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:54.197276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15ab5-f3a8-4534-8945-0a77fb395f05 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:54.199595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 919/1831] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:13:54.202837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:54.203694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:54.203985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:54.206447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] PATH_INFO: `/v3/projects/65c26b5462534b7f8672d8dbd516a3fb` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:54.208713 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c26b5462534b7f8672d8dbd516a3fb)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:54.216664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:54.350862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c26b5462534b7f8672d8dbd516a3fb', 'request_id': 'req-3cb95305-a20f-4d2c-9e68-eec03747fa49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:54.368648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c26b5462534b7f8672d8dbd516a3fb', 'request_id': 'req-3cb95305-a20f-4d2c-9e68-eec03747fa49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:54.399053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c26b5462534b7f8672d8dbd516a3fb', 'request_id': 'req-3cb95305-a20f-4d2c-9e68-eec03747fa49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:54.436744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] The token cache is being invalidate because project 65c26b5462534b7f8672d8dbd516a3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:54.437472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:54.442159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cb95305-a20f-4d2c-9e68-eec03747fa49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:54.455578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 913/1832] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:53 2022] DELETE /identity/v3/projects/65c26b5462534b7f8672d8dbd516a3fb => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:13:54.456043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15ab5-f3a8-4534-8945-0a77fb395f05 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:54.456043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-82f15ab5-f3a8-4534-8945-0a77fb395f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:54.479907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422ca8e-16ba-454d-b12c-373096ae62df None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:54.480241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422ca8e-16ba-454d-b12c-373096ae62df None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:54.480797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422ca8e-16ba-454d-b12c-373096ae62df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:54.570165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0422ca8e-16ba-454d-b12c-373096ae62df None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:54.576471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0422ca8e-16ba-454d-b12c-373096ae62df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:54.641716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:54.680987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15ab5-f3a8-4534-8945-0a77fb395f05 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:54.707733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:54.708386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:54.708701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:54.708938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] PATH_INFO: `/v3/users/06d7b0518e714d5284eb8d4c12660469` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:54.712976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d7b0518e714d5284eb8d4c12660469)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:54.734442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:54.778163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 914/1833] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:54.922403 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d7b0518e714d5284eb8d4c12660469'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:54.974898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d7b0518e714d5284eb8d4c12660469'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:54.999453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d7b0518e714d5284eb8d4c12660469'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:55.000235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d7b0518e714d5284eb8d4c12660469'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:55.012747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a65ae3ad-c042-4bef-bbbc-3ccd3a1b111e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d7b0518e714d5284eb8d4c12660469'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:55.046918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 920/1834] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:54 2022] DELETE /identity/v3/users/06d7b0518e714d5284eb8d4c12660469 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:55.111922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422ca8e-16ba-454d-b12c-373096ae62df None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:55.113690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0422ca8e-16ba-454d-b12c-373096ae62df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:55.149539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422ca8e-16ba-454d-b12c-373096ae62df None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:55.348470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:55.349146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:55.349976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:55.350506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] PATH_INFO: `/v3/projects/74a589bdc328486786eabd391338d814` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:55.357114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a589bdc328486786eabd391338d814)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:55.358486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:55.397379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:55.485094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a589bdc328486786eabd391338d814', 'request_id': 'req-51a79a82-34c3-4fa5-bd89-6bccc4565be0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:55.502123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a589bdc328486786eabd391338d814', 'request_id': 'req-51a79a82-34c3-4fa5-bd89-6bccc4565be0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:55.528471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a589bdc328486786eabd391338d814', 'request_id': 'req-51a79a82-34c3-4fa5-bd89-6bccc4565be0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:55.554523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] The token cache is being invalidate because project 74a589bdc328486786eabd391338d814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:55.556282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:55.558186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-51a79a82-34c3-4fa5-bd89-6bccc4565be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:55.567438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 915/1835] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:55 2022] DELETE /identity/v3/projects/74a589bdc328486786eabd391338d814 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:55.568849 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc42cb-8649-4d34-97a6-9238923e00f1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:55.569364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc42cb-8649-4d34-97a6-9238923e00f1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:55.569716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc42cb-8649-4d34-97a6-9238923e00f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:55.640129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-15fc42cb-8649-4d34-97a6-9238923e00f1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:55.665034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-15fc42cb-8649-4d34-97a6-9238923e00f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:55.919576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 921/1836] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:55.932980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c825fae-d37b-4b7d-b6dd-b64f21408c38 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:55.933888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c825fae-d37b-4b7d-b6dd-b64f21408c38 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:55.934254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c825fae-d37b-4b7d-b6dd-b64f21408c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:56.000156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2c825fae-d37b-4b7d-b6dd-b64f21408c38 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:56.002438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2c825fae-d37b-4b7d-b6dd-b64f21408c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:56.023939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 916/1837] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:56.025179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc42cb-8649-4d34-97a6-9238923e00f1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:56.041554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc42cb-8649-4d34-97a6-9238923e00f1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:56.047592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:56.048350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:56.048636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:56.049061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:56.049832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:56.050288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:56.052834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:56.090079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c825fae-d37b-4b7d-b6dd-b64f21408c38 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:56.105580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 922/1838] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:13:56.109129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c825fae-d37b-4b7d-b6dd-b64f21408c38 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:56.137227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e02c4-17e8-4159-afa5-173444403fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:56.137915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e02c4-17e8-4159-afa5-173444403fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:56.138168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e02c4-17e8-4159-afa5-173444403fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:56.138443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e02c4-17e8-4159-afa5-173444403fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:56.139092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e02c4-17e8-4159-afa5-173444403fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:56.144744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e02c4-17e8-4159-afa5-173444403fdd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:56.258172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 917/1839] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:56 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:56.262630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:56.278881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d01bf-d425-487a-abf7-e3a223cb6fc2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:56.458804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:56.474796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c0bd-2dfc-443b-bae8-51cf2311c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:56.475506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c0bd-2dfc-443b-bae8-51cf2311c4eb admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:56.475920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c0bd-2dfc-443b-bae8-51cf2311c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:56.476185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c0bd-2dfc-443b-bae8-51cf2311c4eb admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:56.476764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5c0bd-2dfc-443b-bae8-51cf2311c4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:56.483054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5c0bd-2dfc-443b-bae8-51cf2311c4eb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:56.544893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 923/1840] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:56 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:56.546809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e02c4-17e8-4159-afa5-173444403fdd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:56.582794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e02c4-17e8-4159-afa5-173444403fdd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:56.597649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:56.599604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:56.599907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:56.600777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:56.603980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:56.610156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:56.640043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 918/1841] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:56.644645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c0bd-2dfc-443b-bae8-51cf2311c4eb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:56.657685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:56.664222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:56.670107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c0bd-2dfc-443b-bae8-51cf2311c4eb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:56.701758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd67c5-fb55-48f2-a542-4d18b10bca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:56.702483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd67c5-fb55-48f2-a542-4d18b10bca2f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:56.702927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd67c5-fb55-48f2-a542-4d18b10bca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:56.703104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd67c5-fb55-48f2-a542-4d18b10bca2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:56.703887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd67c5-fb55-48f2-a542-4d18b10bca2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:56.715087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd67c5-fb55-48f2-a542-4d18b10bca2f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:56.728836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f53161-d909-4bce-9fcd-f73137b2eb98 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:56.743838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:56.744524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:56.744805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:56.745653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] PATH_INFO: `/v3/projects/765944e5e0074635a93d457a9e0f95ce` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:56.763956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=765944e5e0074635a93d457a9e0f95ce)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:56.766040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:56.775314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 924/1842] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:56.781026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd67c5-fb55-48f2-a542-4d18b10bca2f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:56.814889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd67c5-fb55-48f2-a542-4d18b10bca2f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:56.841334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba5198-4e1c-4b02-bc20-bff0c670f3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:56.842244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5198-4e1c-4b02-bc20-bff0c670f3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:56.842559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5198-4e1c-4b02-bc20-bff0c670f3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:56.842857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5198-4e1c-4b02-bc20-bff0c670f3f6 admin admin] PATH_INFO: `/v3/projects/f432823f04564d42a4f157826258a154/users/b660df3fca314b1cb156bb59acccf04c/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:56.905384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba5198-4e1c-4b02-bc20-bff0c670f3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f432823f04564d42a4f157826258a154, user_id=b660df3fca314b1cb156bb59acccf04c, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:56.908514 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba5198-4e1c-4b02-bc20-bff0c670f3f6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:56.960153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765944e5e0074635a93d457a9e0f95ce', 'request_id': 'req-4159b80a-d59b-436f-a957-b76c3baf4ecb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:56.973433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765944e5e0074635a93d457a9e0f95ce', 'request_id': 'req-4159b80a-d59b-436f-a957-b76c3baf4ecb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:56.994530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765944e5e0074635a93d457a9e0f95ce', 'request_id': 'req-4159b80a-d59b-436f-a957-b76c3baf4ecb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:57.002285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 925/1843] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:56 2022] PUT /identity/v3/projects/f432823f04564d42a4f157826258a154/users/b660df3fca314b1cb156bb59acccf04c/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:57.015199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40bbe0-687d-4123-8eb7-ef8da9e4ed38 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:57.016011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40bbe0-687d-4123-8eb7-ef8da9e4ed38 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:57.022018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] The token cache is being invalidate because project 765944e5e0074635a93d457a9e0f95ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:57.022341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:57.022904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40bbe0-687d-4123-8eb7-ef8da9e4ed38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:57.026033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:57.036633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 919/1844] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:56 2022] DELETE /identity/v3/projects/765944e5e0074635a93d457a9e0f95ce => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:57.037915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:57.039858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:57.144099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9f40bbe0-687d-4123-8eb7-ef8da9e4ed38 None None] MFA Rules not processed for user `b660df3fca314b1cb156bb59acccf04c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:57.145538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9f40bbe0-687d-4123-8eb7-ef8da9e4ed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:57.255042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:57.324485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159b80a-d59b-436f-a957-b76c3baf4ecb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:57.404730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 926/1845] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:57.414506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40bbe0-687d-4123-8eb7-ef8da9e4ed38 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:57.416035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9f40bbe0-687d-4123-8eb7-ef8da9e4ed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:57.589652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:57.594164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:57.594540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:57.594824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] PATH_INFO: `/v3/users/2e2af0cc2b3d4f0c95a5860be3d393da` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:57.611257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2af0cc2b3d4f0c95a5860be3d393da)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:57.617042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:57.729478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40bbe0-687d-4123-8eb7-ef8da9e4ed38 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:57.739629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:57.740740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:57.741297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:57.742258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:57.743242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:57.746353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:57.754057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2af0cc2b3d4f0c95a5860be3d393da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:57.765821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2af0cc2b3d4f0c95a5860be3d393da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:57.791223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2af0cc2b3d4f0c95a5860be3d393da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:57.792092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2af0cc2b3d4f0c95a5860be3d393da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:57.806202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2af0cc2b3d4f0c95a5860be3d393da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:57.807622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 927/1846] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:57 2022] POST /identity/v3/projects => generated 385 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:57.811425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:57.822489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:57.828452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 920/1847] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:13:57 2022] DELETE /identity/v3/users/2e2af0cc2b3d4f0c95a5860be3d393da => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:57.829791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:57.837086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:57.970501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:58.100970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578dbad-ba2c-42b7-af9e-f3e957f70a6b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:58.112838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:58.122297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:58.122643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:58.122878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:58.130667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:58.142850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:58.170813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:58.172464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:58.204356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a4bcc-25c4-4ff5-a395-d179f9b3236f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:58.212906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 921/1848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:13:58.217813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:58.222210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:58.460483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b519507-a9b1-4bdd-9169-42bdd09d27b0 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:58.472795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ade270-b1c3-4abc-a7f6-8442108825d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:58.473362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade270-b1c3-4abc-a7f6-8442108825d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:58.473674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade270-b1c3-4abc-a7f6-8442108825d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:58.475528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade270-b1c3-4abc-a7f6-8442108825d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:58.486644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ade270-b1c3-4abc-a7f6-8442108825d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:58.487851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:58.490538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:58.496739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ade270-b1c3-4abc-a7f6-8442108825d5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:58.501247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:58.501424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] PATH_INFO: `/v3/projects/bc4c1370aa86463dbf38142d936398fd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:58.503544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4c1370aa86463dbf38142d936398fd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:58.506240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:58.641855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 922/1849] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:13:58 2022] POST /identity/v3/users => generated 299 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:58.643730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee018f5-a0ec-4ea5-8a89-20951d929834 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:58.646788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee018f5-a0ec-4ea5-8a89-20951d929834 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:58.649970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee018f5-a0ec-4ea5-8a89-20951d929834 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:58.656274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 923/1850] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:13:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:13:58.658090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee018f5-a0ec-4ea5-8a89-20951d929834 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:58.705923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4c1370aa86463dbf38142d936398fd', 'request_id': 'req-f4f58457-39c0-48ca-b502-3c546dcd4405'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:58.722247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4c1370aa86463dbf38142d936398fd', 'request_id': 'req-f4f58457-39c0-48ca-b502-3c546dcd4405'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:58.726546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee018f5-a0ec-4ea5-8a89-20951d929834 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:58.736059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4c1370aa86463dbf38142d936398fd', 'request_id': 'req-f4f58457-39c0-48ca-b502-3c546dcd4405'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:58.764545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] The token cache is being invalidate because project bc4c1370aa86463dbf38142d936398fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:13:58.764545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:58.767499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f4f58457-39c0-48ca-b502-3c546dcd4405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:13:58.772810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 928/1851] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:57 2022] DELETE /identity/v3/projects/bc4c1370aa86463dbf38142d936398fd => generated 0 bytes in 961 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:58.777785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956096-5087-4de4-bdc6-f5045eba271b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:58.778646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956096-5087-4de4-bdc6-f5045eba271b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:58.780053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d956096-5087-4de4-bdc6-f5045eba271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:58.843351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0d956096-5087-4de4-bdc6-f5045eba271b None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:58.845261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0d956096-5087-4de4-bdc6-f5045eba271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:58.952171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e57f9-97c9-4391-8a22-03899c82bc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:58.953387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e57f9-97c9-4391-8a22-03899c82bc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:58.954878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e57f9-97c9-4391-8a22-03899c82bc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:58.955168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e57f9-97c9-4391-8a22-03899c82bc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:58.958387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e57f9-97c9-4391-8a22-03899c82bc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:58.961965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e57f9-97c9-4391-8a22-03899c82bc82 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:59.028349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 924/1852] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:13:59.038946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad61ac-83ac-4765-8d04-e9f53c8f7af9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:59.040732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad61ac-83ac-4765-8d04-e9f53c8f7af9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:59.043172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad61ac-83ac-4765-8d04-e9f53c8f7af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:59.118796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:59.149904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8cad61ac-83ac-4765-8d04-e9f53c8f7af9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:59.159932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8cad61ac-83ac-4765-8d04-e9f53c8f7af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:59.181677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 929/1853] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:59.185569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d956096-5087-4de4-bdc6-f5045eba271b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:59.187821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 925/1854] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:59.194282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0d956096-5087-4de4-bdc6-f5045eba271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:59.218126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefac25-c1ab-4ad5-8452-6b1c4b4529e7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:59.224100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefac25-c1ab-4ad5-8452-6b1c4b4529e7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:59.225781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefac25-c1ab-4ad5-8452-6b1c4b4529e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:59.264722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d956096-5087-4de4-bdc6-f5045eba271b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:59.289048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f0e89-d34d-4d8c-998b-b253e14bbc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:59.290089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0e89-d34d-4d8c-998b-b253e14bbc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:59.290448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0e89-d34d-4d8c-998b-b253e14bbc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:59.291141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0e89-d34d-4d8c-998b-b253e14bbc4b admin admin] PATH_INFO: `/v3/projects/e48b9e4214be482abe1bd310bd65d3dd/users/3b2ee452c39a472586bddb07d1a74ac9/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:59.304984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7cefac25-c1ab-4ad5-8452-6b1c4b4529e7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:13:59.308933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7cefac25-c1ab-4ad5-8452-6b1c4b4529e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:59.332788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 926/1855] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:13:59.337186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefac25-c1ab-4ad5-8452-6b1c4b4529e7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:59.349814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0e89-d34d-4d8c-998b-b253e14bbc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48b9e4214be482abe1bd310bd65d3dd, user_id=3b2ee452c39a472586bddb07d1a74ac9, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:59.350202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefac25-c1ab-4ad5-8452-6b1c4b4529e7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:59.359875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:59.360650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:59.361283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:59.362106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:59.363720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:13:59.364703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:59.366956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:59.376020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0e89-d34d-4d8c-998b-b253e14bbc4b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:59.394132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 927/1856] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:13:59.394132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:59.410050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1519-2e55-4fda-812d-82661c89c937 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:59.424142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 930/1857] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:13:59 2022] PUT /identity/v3/projects/e48b9e4214be482abe1bd310bd65d3dd/users/3b2ee452c39a472586bddb07d1a74ac9/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:13:59.429057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f0e89-d34d-4d8c-998b-b253e14bbc4b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:59.597095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:59.636664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:59.637314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:59.637642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:59.637913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:59.638558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:59.640602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:59.646996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f0e89-d34d-4d8c-998b-b253e14bbc4b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:59.659818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:59.660463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:59.660762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:59.661055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:59.661938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:59.663476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:59.702043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 931/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:13:59.702043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:59.708793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:59.720600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 928/1859] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:13:59 2022] POST /identity/v3/projects => generated 389 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:13:59.721578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:13:59.729008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:13:59.730493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7386c58-dff6-45be-aeeb-52445f7338f6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:59.852451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:59.854620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:59.854913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:59.856389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] PATH_INFO: `/v3/projects/a891501e387e4483be7ad07ca322c325` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:59.859771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a891501e387e4483be7ad07ca322c325)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:59.864410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:13:59.938072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40616676-1569-4c9a-a731-fda1f45cbef3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:13:59.947867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086ec8-dab9-4342-adf0-b3c8fb0a6b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:13:59.949096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086ec8-dab9-4342-adf0-b3c8fb0a6b56 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:13:59.949495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086ec8-dab9-4342-adf0-b3c8fb0a6b56 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:13:59.949843 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086ec8-dab9-4342-adf0-b3c8fb0a6b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:13:59.980314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2086ec8-dab9-4342-adf0-b3c8fb0a6b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:13:59.985882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2086ec8-dab9-4342-adf0-b3c8fb0a6b56 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:00.017390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a891501e387e4483be7ad07ca322c325', 'request_id': 'req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:00.039515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 929/1860] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:00.040735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a891501e387e4483be7ad07ca322c325', 'request_id': 'req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:00.042532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086ec8-dab9-4342-adf0-b3c8fb0a6b56 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:00.058803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a891501e387e4483be7ad07ca322c325', 'request_id': 'req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:00.072024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086ec8-dab9-4342-adf0-b3c8fb0a6b56 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:00.077040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:00.094714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] The token cache is being invalidate because project a891501e387e4483be7ad07ca322c325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:00.095017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:00.097589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:00.105647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 932/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:13:59 2022] DELETE /identity/v3/projects/a891501e387e4483be7ad07ca322c325 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:00.106866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:00.110714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:00.236591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ae2c4-f177-4371-9e3d-ff2d3561dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:00.237454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ae2c4-f177-4371-9e3d-ff2d3561dadf admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.237663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ae2c4-f177-4371-9e3d-ff2d3561dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.237907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ae2c4-f177-4371-9e3d-ff2d3561dadf admin admin] PATH_INFO: `/v3/projects/e48b9e4214be482abe1bd310bd65d3dd/users/3b2ee452c39a472586bddb07d1a74ac9/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.243547 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ae2c4-f177-4371-9e3d-ff2d3561dadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48b9e4214be482abe1bd310bd65d3dd, user_id=3b2ee452c39a472586bddb07d1a74ac9, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:00.249858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ae2c4-f177-4371-9e3d-ff2d3561dadf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:00.272536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 930/1862] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:00 2022] PUT /identity/v3/projects/e48b9e4214be482abe1bd310bd65d3dd/users/3b2ee452c39a472586bddb07d1a74ac9/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:00.274007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594dbc-f82b-4b6e-9317-dfac300a64a0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.274294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594dbc-f82b-4b6e-9317-dfac300a64a0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.274566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594dbc-f82b-4b6e-9317-dfac300a64a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.307081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-62594dbc-f82b-4b6e-9317-dfac300a64a0 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:00.320585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-62594dbc-f82b-4b6e-9317-dfac300a64a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:00.331586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53565e13-7ce4-40ad-8ef9-9c86a0f36f74 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:00.562893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:00.564137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff497-7997-4d74-96c3-9a0a6ee7287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:00.564962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff497-7997-4d74-96c3-9a0a6ee7287a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.565281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff497-7997-4d74-96c3-9a0a6ee7287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.565603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff497-7997-4d74-96c3-9a0a6ee7287a admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.566428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeff497-7997-4d74-96c3-9a0a6ee7287a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:00.581276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeff497-7997-4d74-96c3-9a0a6ee7287a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:00.591588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 931/1863] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:00.593226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fafbf-b665-45be-8426-5e4a19533352 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.594905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fafbf-b665-45be-8426-5e4a19533352 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.606069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fafbf-b665-45be-8426-5e4a19533352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.631223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 933/1864] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:00 2022] POST /identity/v3/users => generated 295 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:00.636683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0b47-3849-411f-ae41-7590b7c6be4d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.637364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0b47-3849-411f-ae41-7590b7c6be4d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.639778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0b47-3849-411f-ae41-7590b7c6be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.676826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1afb0b47-3849-411f-ae41-7590b7c6be4d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:00.678668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1afb0b47-3849-411f-ae41-7590b7c6be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:00.690712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 934/1865] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:00.696079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb0b47-3849-411f-ae41-7590b7c6be4d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:00.709715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-920fafbf-b665-45be-8426-5e4a19533352 None None] MFA Rules not processed for user `3b2ee452c39a472586bddb07d1a74ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:00.711407 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-920fafbf-b665-45be-8426-5e4a19533352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:00.717262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb0b47-3849-411f-ae41-7590b7c6be4d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:00.724183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14622669-718c-4a33-ac85-6e0cae0f4c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:00.724879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14622669-718c-4a33-ac85-6e0cae0f4c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.725232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14622669-718c-4a33-ac85-6e0cae0f4c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.725628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14622669-718c-4a33-ac85-6e0cae0f4c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.727016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14622669-718c-4a33-ac85-6e0cae0f4c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:00.729198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14622669-718c-4a33-ac85-6e0cae0f4c5e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:00.743116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 935/1866] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:00.744084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14622669-718c-4a33-ac85-6e0cae0f4c5e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:00.759068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14622669-718c-4a33-ac85-6e0cae0f4c5e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:00.768269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:00.769162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.769428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.769930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.770762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:00.771161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:00.773210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:00.806179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 936/1867] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:00.808019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:00.838727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3922ca8-e122-4109-af3c-9aacc15dfd2f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:00.853575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:00.855593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.855963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.856306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.857079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:00.861126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:00.919180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 932/1868] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:00.920496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fafbf-b665-45be-8426-5e4a19533352 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:00.956906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fafbf-b665-45be-8426-5e4a19533352 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:00.969917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c2f2e-a3e6-40e5-9783-6c5830d724bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:00.970786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2f2e-a3e6-40e5-9783-6c5830d724bb admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:00.974296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2f2e-a3e6-40e5-9783-6c5830d724bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:00.974296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2f2e-a3e6-40e5-9783-6c5830d724bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:00.975335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c2f2e-a3e6-40e5-9783-6c5830d724bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:00.980632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 937/1869] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:00.982416 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:00.986802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c2f2e-a3e6-40e5-9783-6c5830d724bb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:00.989920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:01.075505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 933/1870] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:00 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:01.079069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c2f2e-a3e6-40e5-9783-6c5830d724bb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:01.220764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbb561-e127-4615-8563-cb4a936fdea3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:01.241524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:01.258658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c2f2e-a3e6-40e5-9783-6c5830d724bb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:01.272020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fbbf5-e271-42b0-afd1-90fa7b876afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:01.272875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fbbf5-e271-42b0-afd1-90fa7b876afa admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.273226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fbbf5-e271-42b0-afd1-90fa7b876afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.273528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fbbf5-e271-42b0-afd1-90fa7b876afa admin admin] PATH_INFO: `/v3/projects/f19ddcda04664ce58819f80e4cfdaa29/users/0e1e11e691384262af1b0696ce145f17/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.319221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fbbf5-e271-42b0-afd1-90fa7b876afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19ddcda04664ce58819f80e4cfdaa29, user_id=0e1e11e691384262af1b0696ce145f17, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:01.322712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fbbf5-e271-42b0-afd1-90fa7b876afa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:01.382229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 934/1871] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:01 2022] PUT /identity/v3/projects/f19ddcda04664ce58819f80e4cfdaa29/users/0e1e11e691384262af1b0696ce145f17/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:01.384084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fbbf5-e271-42b0-afd1-90fa7b876afa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:01.397308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ce954-d30f-4dea-92b2-cd250db4155a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:01.399278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ce954-d30f-4dea-92b2-cd250db4155a service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.399700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ce954-d30f-4dea-92b2-cd250db4155a service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.400775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ce954-d30f-4dea-92b2-cd250db4155a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.502334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:01.539358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fbbf5-e271-42b0-afd1-90fa7b876afa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:01.563505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ce954-d30f-4dea-92b2-cd250db4155a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:01.564080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154229-824f-4fb2-8988-b456a9c17440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:01.564882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154229-824f-4fb2-8988-b456a9c17440 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.565031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ce954-d30f-4dea-92b2-cd250db4155a service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:01.566439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154229-824f-4fb2-8988-b456a9c17440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.567885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f154229-824f-4fb2-8988-b456a9c17440 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.570164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f154229-824f-4fb2-8988-b456a9c17440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:01.575772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f154229-824f-4fb2-8988-b456a9c17440 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:01.577256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 938/1872] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:01.578676 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1cd6-30aa-43f6-b098-7d9cf372ee23 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.579086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1cd6-30aa-43f6-b098-7d9cf372ee23 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.579371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1cd6-30aa-43f6-b098-7d9cf372ee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.622065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ccac1cd6-30aa-43f6-b098-7d9cf372ee23 None None] MFA Rules not processed for user `0e1e11e691384262af1b0696ce145f17`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:01.629583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ccac1cd6-30aa-43f6-b098-7d9cf372ee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:01.632401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 935/1873] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:01 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:01.633367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154229-824f-4fb2-8988-b456a9c17440 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:01.654485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f154229-824f-4fb2-8988-b456a9c17440 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:01.665281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c9c6-a258-4990-8ab3-1bdd2b92e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:01.666196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c9c6-a258-4990-8ab3-1bdd2b92e651 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.667347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c9c6-a258-4990-8ab3-1bdd2b92e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.667935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c9c6-a258-4990-8ab3-1bdd2b92e651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.669462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746c9c6-a258-4990-8ab3-1bdd2b92e651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:01.673172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746c9c6-a258-4990-8ab3-1bdd2b92e651 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:01.690663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 936/1874] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:01.694836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c9c6-a258-4990-8ab3-1bdd2b92e651 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:01.710439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c9c6-a258-4990-8ab3-1bdd2b92e651 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:01.717585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629354b2-1d30-4bc2-981e-4545e55b59b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:01.718490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629354b2-1d30-4bc2-981e-4545e55b59b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.719083 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629354b2-1d30-4bc2-981e-4545e55b59b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.719932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629354b2-1d30-4bc2-981e-4545e55b59b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.722345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629354b2-1d30-4bc2-981e-4545e55b59b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:01.725041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629354b2-1d30-4bc2-981e-4545e55b59b7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:01.755072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 937/1875] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:01.756291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629354b2-1d30-4bc2-981e-4545e55b59b7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:01.780779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629354b2-1d30-4bc2-981e-4545e55b59b7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:01.809637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf468-72e1-4802-a8da-7fbdae09a5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:01.812315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf468-72e1-4802-a8da-7fbdae09a5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.813148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf468-72e1-4802-a8da-7fbdae09a5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.814880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf468-72e1-4802-a8da-7fbdae09a5b9 admin admin] PATH_INFO: `/v3/projects/e23c8a24eeaa448397211350412903b1/users/f68d9a2b2d60452e93e534c8ab6d62c6/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.828221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 939/1876] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:01.832156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac1cd6-30aa-43f6-b098-7d9cf372ee23 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:01.848125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf468-72e1-4802-a8da-7fbdae09a5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23c8a24eeaa448397211350412903b1, user_id=f68d9a2b2d60452e93e534c8ab6d62c6, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:01.855506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf468-72e1-4802-a8da-7fbdae09a5b9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:01.858256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac1cd6-30aa-43f6-b098-7d9cf372ee23 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:01.872915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13535d5c-e8cd-4f39-921d-eb3dcb7a3032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:01.873849 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535d5c-e8cd-4f39-921d-eb3dcb7a3032 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.874139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535d5c-e8cd-4f39-921d-eb3dcb7a3032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.874464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535d5c-e8cd-4f39-921d-eb3dcb7a3032 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.875942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13535d5c-e8cd-4f39-921d-eb3dcb7a3032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:01.883045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13535d5c-e8cd-4f39-921d-eb3dcb7a3032 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:01.885139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 938/1877] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:01 2022] PUT /identity/v3/projects/e23c8a24eeaa448397211350412903b1/users/f68d9a2b2d60452e93e534c8ab6d62c6/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:01.899284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8f584-e149-436d-abc9-3b05e80b44d2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:01.899811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8f584-e149-436d-abc9-3b05e80b44d2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:01.900445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8f584-e149-436d-abc9-3b05e80b44d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:01.965169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-57e8f584-e149-436d-abc9-3b05e80b44d2 None None] MFA Rules not processed for user `f68d9a2b2d60452e93e534c8ab6d62c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:01.966059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 940/1878] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:01 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:01.969669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-57e8f584-e149-436d-abc9-3b05e80b44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:01.970847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13535d5c-e8cd-4f39-921d-eb3dcb7a3032 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.052480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:02.074103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 939/1879] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:02.087258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8f584-e149-436d-abc9-3b05e80b44d2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.089314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-57e8f584-e149-436d-abc9-3b05e80b44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:02.129305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13535d5c-e8cd-4f39-921d-eb3dcb7a3032 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.135074 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a322-de9c-4b6b-873b-e76cb3994627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.136129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a322-de9c-4b6b-873b-e76cb3994627 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.136386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a322-de9c-4b6b-873b-e76cb3994627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.137143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a322-de9c-4b6b-873b-e76cb3994627 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.137813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7a322-de9c-4b6b-873b-e76cb3994627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.140870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7a322-de9c-4b6b-873b-e76cb3994627 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.178553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 941/1880] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:01 2022] POST /identity/v3/users => generated 303 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:02.182689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a322-de9c-4b6b-873b-e76cb3994627 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.205207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a322-de9c-4b6b-873b-e76cb3994627 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.217035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12860d2-dfb6-4d15-89b7-698d7fc5edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.217924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12860d2-dfb6-4d15-89b7-698d7fc5edc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.218355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12860d2-dfb6-4d15-89b7-698d7fc5edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.218725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12860d2-dfb6-4d15-89b7-698d7fc5edc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.219662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12860d2-dfb6-4d15-89b7-698d7fc5edc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.222196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12860d2-dfb6-4d15-89b7-698d7fc5edc9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.233360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8f584-e149-436d-abc9-3b05e80b44d2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.238736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5350bb-1bb4-4056-851e-d1fe1ae5f7a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.240643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5350bb-1bb4-4056-851e-d1fe1ae5f7a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.240997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5350bb-1bb4-4056-851e-d1fe1ae5f7a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.241352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5350bb-1bb4-4056-851e-d1fe1ae5f7a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.250765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 942/1881] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:02.256141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12860d2-dfb6-4d15-89b7-698d7fc5edc9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.258749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5350bb-1bb4-4056-851e-d1fe1ae5f7a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.260593 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5350bb-1bb4-4056-851e-d1fe1ae5f7a4 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.278411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 940/1882] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:02.289883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12860d2-dfb6-4d15-89b7-698d7fc5edc9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.296191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff06a-6407-4fc1-9eec-7db15ee0d234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.297273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff06a-6407-4fc1-9eec-7db15ee0d234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.299183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff06a-6407-4fc1-9eec-7db15ee0d234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.299925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff06a-6407-4fc1-9eec-7db15ee0d234 admin admin] PATH_INFO: `/v3/projects/f085c0872edb47c086715e03853e16f9/users/8d699b38f72c4c06a1c9b246d4a725c3/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.301137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5350bb-1bb4-4056-851e-d1fe1ae5f7a4 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.339304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5350bb-1bb4-4056-851e-d1fe1ae5f7a4 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.342299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acff06a-6407-4fc1-9eec-7db15ee0d234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f085c0872edb47c086715e03853e16f9, user_id=8d699b38f72c4c06a1c9b246d4a725c3, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.344978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acff06a-6407-4fc1-9eec-7db15ee0d234 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.353270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.354408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.354694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.354969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] PATH_INFO: `/v3/users/f68d9a2b2d60452e93e534c8ab6d62c6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.357056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68d9a2b2d60452e93e534c8ab6d62c6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.358529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.377003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 943/1883] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:02 2022] PUT /identity/v3/projects/f085c0872edb47c086715e03853e16f9/users/8d699b38f72c4c06a1c9b246d4a725c3/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:02.380897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff06a-6407-4fc1-9eec-7db15ee0d234 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.393182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:02.439456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68d9a2b2d60452e93e534c8ab6d62c6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:02.451162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68d9a2b2d60452e93e534c8ab6d62c6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:02.482471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68d9a2b2d60452e93e534c8ab6d62c6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:02.483238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68d9a2b2d60452e93e534c8ab6d62c6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:02.491177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-059d376c-c3f5-479d-bf48-b9a794994f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68d9a2b2d60452e93e534c8ab6d62c6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:02.499520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 941/1884] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:02 2022] DELETE /identity/v3/users/f68d9a2b2d60452e93e534c8ab6d62c6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:02.508097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74222ae-256d-4ae5-96dc-8b698b411b07 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.508097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74222ae-256d-4ae5-96dc-8b698b411b07 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.508097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74222ae-256d-4ae5-96dc-8b698b411b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.519889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff06a-6407-4fc1-9eec-7db15ee0d234 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.531032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a74222ae-256d-4ae5-96dc-8b698b411b07 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:02.532630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a74222ae-256d-4ae5-96dc-8b698b411b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:02.622436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.624821 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.625282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.625929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.627499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.629813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.647477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 944/1885] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:02.652728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.657360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 942/1886] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:02.658449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:02.665891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74222ae-256d-4ae5-96dc-8b698b411b07 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.668284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a74222ae-256d-4ae5-96dc-8b698b411b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:02.680361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660105-1c29-410e-b66e-fb6d07390dab admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.697603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.697603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.697603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.697603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] PATH_INFO: `/v3/projects/f085c0872edb47c086715e03853e16f9/users/8d699b38f72c4c06a1c9b246d4a725c3/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.700180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f085c0872edb47c086715e03853e16f9, user_id=8d699b38f72c4c06a1c9b246d4a725c3, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.702952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.717658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 945/1887] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:02 2022] PUT /identity/v3/projects/f085c0872edb47c086715e03853e16f9/users/8d699b38f72c4c06a1c9b246d4a725c3/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:02.723022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:02.725823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:02.748727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:02.801577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74222ae-256d-4ae5-96dc-8b698b411b07 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.824688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb873-44fe-4efb-bea1-55a336c08bf9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:02.830926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.831842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.832227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.832392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] PATH_INFO: `/v3/users/b660df3fca314b1cb156bb59acccf04c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.833974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b660df3fca314b1cb156bb59acccf04c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.836864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.884618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:02.897909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7688e2-06fa-49b2-a414-ebf22b4729ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:02.898960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7688e2-06fa-49b2-a414-ebf22b4729ec service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.899461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7688e2-06fa-49b2-a414-ebf22b4729ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.899845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7688e2-06fa-49b2-a414-ebf22b4729ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.914999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7688e2-06fa-49b2-a414-ebf22b4729ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:02.917031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7688e2-06fa-49b2-a414-ebf22b4729ec service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:02.930915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 943/1888] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:02.931985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b660df3fca314b1cb156bb59acccf04c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:02.932998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483a32e-d292-4ff2-a6b3-4b5bc57b1aa4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:02.933078 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483a32e-d292-4ff2-a6b3-4b5bc57b1aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:02.933488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483a32e-d292-4ff2-a6b3-4b5bc57b1aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:02.968567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e483a32e-d292-4ff2-a6b3-4b5bc57b1aa4 None None] MFA Rules not processed for user `8d699b38f72c4c06a1c9b246d4a725c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:02.970051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e483a32e-d292-4ff2-a6b3-4b5bc57b1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:02.970800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b660df3fca314b1cb156bb59acccf04c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:02.988112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b660df3fca314b1cb156bb59acccf04c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:02.989122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b660df3fca314b1cb156bb59acccf04c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.011192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7f1cdf7d-569f-4ffc-8fa7-edb23052cc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b660df3fca314b1cb156bb59acccf04c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.031783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 946/1889] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:02 2022] DELETE /identity/v3/users/b660df3fca314b1cb156bb59acccf04c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:03.037993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c596-1fab-4ed3-8efc-e41ff3e234ea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.038346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c596-1fab-4ed3-8efc-e41ff3e234ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.038780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c596-1fab-4ed3-8efc-e41ff3e234ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.069899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ec40c596-1fab-4ed3-8efc-e41ff3e234ea None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:03.071540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ec40c596-1fab-4ed3-8efc-e41ff3e234ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.131047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 944/1890] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:03.149628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483a32e-d292-4ff2-a6b3-4b5bc57b1aa4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:03.157038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e483a32e-d292-4ff2-a6b3-4b5bc57b1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.192787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 947/1891] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:03.220963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c596-1fab-4ed3-8efc-e41ff3e234ea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:03.223178 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ec40c596-1fab-4ed3-8efc-e41ff3e234ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.287777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483a32e-d292-4ff2-a6b3-4b5bc57b1aa4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:03.293731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:03.366189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c596-1fab-4ed3-8efc-e41ff3e234ea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:03.372143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:03.372857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.373185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.373504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.374107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:03.375284 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.375721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.376618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.391702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:03.395102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:03.428598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 948/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:03.429427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:03.431343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.447278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30878660-a31f-48f8-954c-c1fa8354aa7c service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:03.461109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:03.465925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:03.466565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.466844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.467114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] PATH_INFO: `/v3/projects/e23c8a24eeaa448397211350412903b1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.468979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23c8a24eeaa448397211350412903b1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:03.470913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:03.494155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:03.496404 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:03.510692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 945/1893] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:03.557639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23c8a24eeaa448397211350412903b1', 'request_id': 'req-5b543c1a-a603-409c-9001-c2315079aa12'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.567456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23c8a24eeaa448397211350412903b1', 'request_id': 'req-5b543c1a-a603-409c-9001-c2315079aa12'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.574495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23c8a24eeaa448397211350412903b1', 'request_id': 'req-5b543c1a-a603-409c-9001-c2315079aa12'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.591895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] The token cache is being invalidate because project e23c8a24eeaa448397211350412903b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:03.593340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.594202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5b543c1a-a603-409c-9001-c2315079aa12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.596154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 949/1894] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:03 2022] DELETE /identity/v3/projects/e23c8a24eeaa448397211350412903b1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:03.597655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:03.599055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.601013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a4b2-5d4d-4c05-98ec-591132d7cb1a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.601689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a4b2-5d4d-4c05-98ec-591132d7cb1a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.602179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a4b2-5d4d-4c05-98ec-591132d7cb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.610729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d23c-c529-47b6-8bf8-1999c9593327 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:03.627145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6aa9a4b2-5d4d-4c05-98ec-591132d7cb1a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:03.628369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6aa9a4b2-5d4d-4c05-98ec-591132d7cb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.673950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:03.674574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.674858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.675134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.677073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.700926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 950/1895] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:03.710362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638f28-14e3-4f56-9a2d-bcb8ee20d73f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.710777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638f28-14e3-4f56-9a2d-bcb8ee20d73f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.711061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638f28-14e3-4f56-9a2d-bcb8ee20d73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.738821 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-07638f28-14e3-4f56-9a2d-bcb8ee20d73f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:03.740745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-07638f28-14e3-4f56-9a2d-bcb8ee20d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.753672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 951/1896] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:03.756103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638f28-14e3-4f56-9a2d-bcb8ee20d73f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:03.767719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638f28-14e3-4f56-9a2d-bcb8ee20d73f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:03.775227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:03.778023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:03.778493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:03.780789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.781087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.781430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.782154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:03.782476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:03.784295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:03.792691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 946/1897] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:03.793384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:03.795334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:03.816657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 952/1898] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:03.826524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:03.830557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dada6-b18d-4a4c-ac6c-5b3f3e091b64 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:03.841058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a08d2-6cd7-45ca-90e2-078e6ab114f2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:03.843012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:03.843866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.844146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.844418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] PATH_INFO: `/v3/projects/f432823f04564d42a4f157826258a154` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.845580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f432823f04564d42a4f157826258a154)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:03.847553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:03.848393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7157e-7e68-4527-8be5-d5bcd40b83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:03.849591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7157e-7e68-4527-8be5-d5bcd40b83e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:03.850145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7157e-7e68-4527-8be5-d5bcd40b83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:03.850649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7157e-7e68-4527-8be5-d5bcd40b83e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:03.851633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7157e-7e68-4527-8be5-d5bcd40b83e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:03.854745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7157e-7e68-4527-8be5-d5bcd40b83e6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:03.901422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 953/1899] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:03 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:03.906175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7157e-7e68-4527-8be5-d5bcd40b83e6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:03.938783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:03.950141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f432823f04564d42a4f157826258a154', 'request_id': 'req-93036d3c-96f3-4f55-b808-d39535616e36'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.961884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f432823f04564d42a4f157826258a154', 'request_id': 'req-93036d3c-96f3-4f55-b808-d39535616e36'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.976548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f432823f04564d42a4f157826258a154', 'request_id': 'req-93036d3c-96f3-4f55-b808-d39535616e36'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:03.999308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] The token cache is being invalidate because project f432823f04564d42a4f157826258a154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:03.999815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:04.002642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:04.004691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 947/1900] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:03 2022] DELETE /identity/v3/projects/f432823f04564d42a4f157826258a154 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:04.011314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:04.014176 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:04.019337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7157e-7e68-4527-8be5-d5bcd40b83e6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:04.065440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:04.102859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:04.104557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:04.105109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:04.105854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:04.106823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:04.109534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:04.149851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036d3c-96f3-4f55-b808-d39535616e36 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:04.156155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:04.156846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:04.157179 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:04.157481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] PATH_INFO: `/v3/users/3b2ee452c39a472586bddb07d1a74ac9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:04.158637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2ee452c39a472586bddb07d1a74ac9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:04.160755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:04.173656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 954/1901] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:03 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:04.177960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:04.187017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:04.222856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d154b-69a8-4b93-8b78-be1d0bce2610 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:04.238131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc9de-f767-4959-a8d7-aa316e8d1f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:04.238777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc9de-f767-4959-a8d7-aa316e8d1f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:04.239040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc9de-f767-4959-a8d7-aa316e8d1f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:04.239316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc9de-f767-4959-a8d7-aa316e8d1f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:04.240406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc9de-f767-4959-a8d7-aa316e8d1f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:04.242660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cc9de-f767-4959-a8d7-aa316e8d1f2f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:04.255741 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2ee452c39a472586bddb07d1a74ac9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:04.265593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 955/1902] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:04.270165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2ee452c39a472586bddb07d1a74ac9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:04.270934 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc9de-f767-4959-a8d7-aa316e8d1f2f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:04.296506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2ee452c39a472586bddb07d1a74ac9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:04.297163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2ee452c39a472586bddb07d1a74ac9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:04.301574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc9de-f767-4959-a8d7-aa316e8d1f2f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:04.316594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2ee452c39a472586bddb07d1a74ac9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:04.319653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b058f09-7da3-4186-88bc-5476e7e7209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:04.320464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058f09-7da3-4186-88bc-5476e7e7209d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:04.320755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058f09-7da3-4186-88bc-5476e7e7209d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:04.321061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058f09-7da3-4186-88bc-5476e7e7209d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:04.321807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b058f09-7da3-4186-88bc-5476e7e7209d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:04.323448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b058f09-7da3-4186-88bc-5476e7e7209d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:04.337542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 948/1903] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:04 2022] DELETE /identity/v3/users/3b2ee452c39a472586bddb07d1a74ac9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:04.355580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 956/1904] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:04.359493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:04.360975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:04.488228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022c1ba-1faf-41bf-a520-56d70a283014 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:04.496667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:04.498287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:04.498769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:04.499145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] PATH_INFO: `/v3/projects/1c5136115c7e482e9ca9659ea0c57207/users/a3d1af9c8d1849069ffdb44d525ee1ac/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:04.538949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5136115c7e482e9ca9659ea0c57207, user_id=a3d1af9c8d1849069ffdb44d525ee1ac, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:04.545351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:04.587323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 949/1905] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:04 2022] PUT /identity/v3/projects/1c5136115c7e482e9ca9659ea0c57207/users/a3d1af9c8d1849069ffdb44d525ee1ac/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:04.591872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d224-97a8-47cf-988e-1ffed4cf06ba None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:04.592373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d224-97a8-47cf-988e-1ffed4cf06ba None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:04.592825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d224-97a8-47cf-988e-1ffed4cf06ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:04.627906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0952d224-97a8-47cf-988e-1ffed4cf06ba None None] MFA Rules not processed for user `a3d1af9c8d1849069ffdb44d525ee1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:04.629728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0952d224-97a8-47cf-988e-1ffed4cf06ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:04.734242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 957/1906] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:04.740989 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:04.743256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:04.791892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:04.863067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd611-ac3d-49eb-a836-6f723bd9a002 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:04.880953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba87b0-6fba-4524-a117-a040639b00f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:04.880953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba87b0-6fba-4524-a117-a040639b00f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:04.880953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba87b0-6fba-4524-a117-a040639b00f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:04.880953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba87b0-6fba-4524-a117-a040639b00f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:04.922220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba87b0-6fba-4524-a117-a040639b00f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:04.926313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba87b0-6fba-4524-a117-a040639b00f8 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:04.952378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 950/1907] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:05.840098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d224-97a8-47cf-988e-1ffed4cf06ba None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:05.841570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0952d224-97a8-47cf-988e-1ffed4cf06ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:05.866264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:05.925658 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d224-97a8-47cf-988e-1ffed4cf06ba None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:05.937330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:05.937984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:05.938265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:05.938546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] PATH_INFO: `/v3/projects/e48b9e4214be482abe1bd310bd65d3dd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:05.943394 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48b9e4214be482abe1bd310bd65d3dd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:05.945375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:06.012260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48b9e4214be482abe1bd310bd65d3dd', 'request_id': 'req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:06.039071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48b9e4214be482abe1bd310bd65d3dd', 'request_id': 'req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:06.052951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48b9e4214be482abe1bd310bd65d3dd', 'request_id': 'req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:06.081774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] The token cache is being invalidate because project e48b9e4214be482abe1bd310bd65d3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:06.082079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:06.084281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6bf79651-83b3-4fbe-85b0-8c3bd17507c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:06.092701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eaf56-ad3a-44be-ab46-80de91c64501 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:06.093143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eaf56-ad3a-44be-ab46-80de91c64501 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:06.093143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eaf56-ad3a-44be-ab46-80de91c64501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:06.095802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 958/1908] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:05 2022] DELETE /identity/v3/projects/e48b9e4214be482abe1bd310bd65d3dd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:06.131976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dc0eaf56-ad3a-44be-ab46-80de91c64501 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:06.136729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dc0eaf56-ad3a-44be-ab46-80de91c64501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:06.288589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 951/1909] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:06.299135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e200cc-5487-4198-b5d5-e217dbf68b37 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:06.299616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e200cc-5487-4198-b5d5-e217dbf68b37 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:06.300180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e200cc-5487-4198-b5d5-e217dbf68b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:06.328470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b0e200cc-5487-4198-b5d5-e217dbf68b37 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:06.329833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b0e200cc-5487-4198-b5d5-e217dbf68b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:06.352633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 959/1910] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:06.358367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0eaf56-ad3a-44be-ab46-80de91c64501 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:06.370665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0eaf56-ad3a-44be-ab46-80de91c64501 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:06.395470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:06.399462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:06.399918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:06.400212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:06.403009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:06.403239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:06.412100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:06.450196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 952/1911] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:06.454584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e200cc-5487-4198-b5d5-e217dbf68b37 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:06.467091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e200cc-5487-4198-b5d5-e217dbf68b37 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:06.488815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bf301-0fb0-4c79-b485-9414087e93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:06.490473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bf301-0fb0-4c79-b485-9414087e93bb admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:06.494084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bf301-0fb0-4c79-b485-9414087e93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:06.495116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bf301-0fb0-4c79-b485-9414087e93bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:06.495907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bf301-0fb0-4c79-b485-9414087e93bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:06.497779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bf301-0fb0-4c79-b485-9414087e93bb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:06.598646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:06.612127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 960/1912] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:06 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:06.616141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07675-7b4b-46d3-b78c-f8c9a600c2ba admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:06.780263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8943c-f1af-4eef-a1e2-143c3afce520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:06.780263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8943c-f1af-4eef-a1e2-143c3afce520 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:06.780263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8943c-f1af-4eef-a1e2-143c3afce520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:06.780263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8943c-f1af-4eef-a1e2-143c3afce520 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:06.780603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8943c-f1af-4eef-a1e2-143c3afce520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:06.789608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8943c-f1af-4eef-a1e2-143c3afce520 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:06.840229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bf301-0fb0-4c79-b485-9414087e93bb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:06.874235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 953/1913] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:06 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:06.876923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bf301-0fb0-4c79-b485-9414087e93bb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:06.890621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d52a-594a-4e5b-8ab1-66c103ec28ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:06.891265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d52a-594a-4e5b-8ab1-66c103ec28ae admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:06.891549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d52a-594a-4e5b-8ab1-66c103ec28ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:06.891906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d52a-594a-4e5b-8ab1-66c103ec28ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:06.892481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775d52a-594a-4e5b-8ab1-66c103ec28ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:06.896433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775d52a-594a-4e5b-8ab1-66c103ec28ae admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:06.924872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8943c-f1af-4eef-a1e2-143c3afce520 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:06.937357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8943c-f1af-4eef-a1e2-143c3afce520 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:06.939425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 961/1914] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:06.956014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6768cc-7ff4-408b-9b1c-b677bfdd37eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:06.956644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6768cc-7ff4-408b-9b1c-b677bfdd37eb admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:06.956992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6768cc-7ff4-408b-9b1c-b677bfdd37eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:06.957256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6768cc-7ff4-408b-9b1c-b677bfdd37eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:06.958000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6768cc-7ff4-408b-9b1c-b677bfdd37eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:06.962302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6768cc-7ff4-408b-9b1c-b677bfdd37eb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:06.991185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 954/1915] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:06.998161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d52a-594a-4e5b-8ab1-66c103ec28ae admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:07.014233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d52a-594a-4e5b-8ab1-66c103ec28ae admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:07.024323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db1d38-4a82-46bb-b02f-6218ad61a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:07.026771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db1d38-4a82-46bb-b02f-6218ad61a0be admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.027250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db1d38-4a82-46bb-b02f-6218ad61a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.027680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db1d38-4a82-46bb-b02f-6218ad61a0be admin admin] PATH_INFO: `/v3/projects/a658b81477194c7b9640d54c4e3a406c/users/6fd03b9ee1374bc99a5fd5b41dbaf4d9/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.080419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db1d38-4a82-46bb-b02f-6218ad61a0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a658b81477194c7b9640d54c4e3a406c, user_id=6fd03b9ee1374bc99a5fd5b41dbaf4d9, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:07.089985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db1d38-4a82-46bb-b02f-6218ad61a0be admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:07.134823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 962/1916] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:06 2022] PUT /identity/v3/projects/a658b81477194c7b9640d54c4e3a406c/users/6fd03b9ee1374bc99a5fd5b41dbaf4d9/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:07.145691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a94d-0a96-4862-93c5-8a5408bac717 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.146233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a94d-0a96-4862-93c5-8a5408bac717 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.146233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a94d-0a96-4862-93c5-8a5408bac717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.191211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d962a94d-0a96-4862-93c5-8a5408bac717 None None] MFA Rules not processed for user `6fd03b9ee1374bc99a5fd5b41dbaf4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:07.192536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d962a94d-0a96-4862-93c5-8a5408bac717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:07.213381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:07.279594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 955/1917] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:07.284354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db1d38-4a82-46bb-b02f-6218ad61a0be admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:07.348459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:07.365444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db1d38-4a82-46bb-b02f-6218ad61a0be admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:07.371141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef58cc-918d-4fbf-a47f-982db5840ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:07.371765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef58cc-918d-4fbf-a47f-982db5840ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.372048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef58cc-918d-4fbf-a47f-982db5840ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.372322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef58cc-918d-4fbf-a47f-982db5840ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.372981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef58cc-918d-4fbf-a47f-982db5840ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:07.374935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef58cc-918d-4fbf-a47f-982db5840ba1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:07.417975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 963/1918] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:07 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:07.423965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a94d-0a96-4862-93c5-8a5408bac717 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:07.438877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a94d-0a96-4862-93c5-8a5408bac717 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:07.526763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e855c1-313a-421a-b9cb-033f6c6868b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:07.527496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e855c1-313a-421a-b9cb-033f6c6868b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.527749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e855c1-313a-421a-b9cb-033f6c6868b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.528024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e855c1-313a-421a-b9cb-033f6c6868b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.528932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e855c1-313a-421a-b9cb-033f6c6868b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:07.532874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e855c1-313a-421a-b9cb-033f6c6868b9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:07.564897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 956/1919] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:07 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:07.569328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef58cc-918d-4fbf-a47f-982db5840ba1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:07.583525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef58cc-918d-4fbf-a47f-982db5840ba1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:07.589252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29506520-e01c-4e1f-9c17-53430ace7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:07.590374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29506520-e01c-4e1f-9c17-53430ace7de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.590659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29506520-e01c-4e1f-9c17-53430ace7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.591535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29506520-e01c-4e1f-9c17-53430ace7de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.592359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29506520-e01c-4e1f-9c17-53430ace7de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:07.594171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29506520-e01c-4e1f-9c17-53430ace7de5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:07.606476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 964/1920] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:07.610986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e855c1-313a-421a-b9cb-033f6c6868b9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:07.623697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e855c1-313a-421a-b9cb-033f6c6868b9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:07.629844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce2d77-2d42-4b8a-a11e-beea8159f760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:07.630768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2d77-2d42-4b8a-a11e-beea8159f760 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.631035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2d77-2d42-4b8a-a11e-beea8159f760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.631566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2d77-2d42-4b8a-a11e-beea8159f760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.632342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2d77-2d42-4b8a-a11e-beea8159f760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:07.634245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2d77-2d42-4b8a-a11e-beea8159f760 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:07.646901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 957/1921] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:07.651986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29506520-e01c-4e1f-9c17-53430ace7de5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:07.664258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29506520-e01c-4e1f-9c17-53430ace7de5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:07.682614 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8936d97-39bb-4255-9f43-093af1505dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:07.684338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8936d97-39bb-4255-9f43-093af1505dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.685290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8936d97-39bb-4255-9f43-093af1505dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.685963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8936d97-39bb-4255-9f43-093af1505dc3 admin admin] PATH_INFO: `/v3/projects/ce9392dff70048499a669777971b782c/users/86dadbd19f104c4f8561fd7e344e4f83/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.708035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8936d97-39bb-4255-9f43-093af1505dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9392dff70048499a669777971b782c, user_id=86dadbd19f104c4f8561fd7e344e4f83, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:07.709897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8936d97-39bb-4255-9f43-093af1505dc3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:07.730896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 965/1922] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:07 2022] PUT /identity/v3/projects/ce9392dff70048499a669777971b782c/users/86dadbd19f104c4f8561fd7e344e4f83/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:07.742020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf9e1-94f8-405a-bc12-f52e14d479d4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.742850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf9e1-94f8-405a-bc12-f52e14d479d4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.743357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf9e1-94f8-405a-bc12-f52e14d479d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.774479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f90cf9e1-94f8-405a-bc12-f52e14d479d4 None None] MFA Rules not processed for user `86dadbd19f104c4f8561fd7e344e4f83`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:07.775840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f90cf9e1-94f8-405a-bc12-f52e14d479d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:07.872001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 958/1923] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:07.876980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8936d97-39bb-4255-9f43-093af1505dc3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:07.947454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8936d97-39bb-4255-9f43-093af1505dc3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:07.952365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eae4b-b133-4d0e-85f1-b61bf12d63ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:07.952974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eae4b-b133-4d0e-85f1-b61bf12d63ca admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:07.953262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eae4b-b133-4d0e-85f1-b61bf12d63ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:07.953571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eae4b-b133-4d0e-85f1-b61bf12d63ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:07.954217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eae4b-b133-4d0e-85f1-b61bf12d63ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:07.956239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eae4b-b133-4d0e-85f1-b61bf12d63ca admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:07.985872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 966/1924] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:07 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:07.989869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf9e1-94f8-405a-bc12-f52e14d479d4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:08.000598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf9e1-94f8-405a-bc12-f52e14d479d4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:08.032786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:08.069679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9a30-e2c9-401a-b7d9-75aa833534c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:08.070201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9a30-e2c9-401a-b7d9-75aa833534c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.070456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9a30-e2c9-401a-b7d9-75aa833534c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.070795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9a30-e2c9-401a-b7d9-75aa833534c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.071364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e9a30-e2c9-401a-b7d9-75aa833534c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:08.073660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e9a30-e2c9-401a-b7d9-75aa833534c3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:08.108776 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 959/1925] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:07 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:08.110497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eae4b-b133-4d0e-85f1-b61bf12d63ca admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:08.122543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eae4b-b133-4d0e-85f1-b61bf12d63ca admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:08.129352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591877e8-ab3e-445f-82d8-87f8e93eca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:08.130024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591877e8-ab3e-445f-82d8-87f8e93eca59 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.130302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591877e8-ab3e-445f-82d8-87f8e93eca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.130594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591877e8-ab3e-445f-82d8-87f8e93eca59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.131412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591877e8-ab3e-445f-82d8-87f8e93eca59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:08.132987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591877e8-ab3e-445f-82d8-87f8e93eca59 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:08.144653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 967/1926] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:08.156208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9a30-e2c9-401a-b7d9-75aa833534c3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:08.163942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9a30-e2c9-401a-b7d9-75aa833534c3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:08.170764 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:08.171506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.171910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.172255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] PATH_INFO: `/v3/projects/c1f7060e1fda40ce9192c07d03eb3a73/users/d72bd48b4b0b45de98c75228bcb7013c/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.191366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f7060e1fda40ce9192c07d03eb3a73, user_id=d72bd48b4b0b45de98c75228bcb7013c, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:08.194670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:08.213665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 960/1927] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:08 2022] PUT /identity/v3/projects/c1f7060e1fda40ce9192c07d03eb3a73/users/d72bd48b4b0b45de98c75228bcb7013c/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:08.215620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591877e8-ab3e-445f-82d8-87f8e93eca59 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:08.229840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591877e8-ab3e-445f-82d8-87f8e93eca59 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:08.293935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ca2ba-ad81-4b10-8582-3c8aea2c1887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:08.294556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ca2ba-ad81-4b10-8582-3c8aea2c1887 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.294845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ca2ba-ad81-4b10-8582-3c8aea2c1887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.295126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ca2ba-ad81-4b10-8582-3c8aea2c1887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.295876 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ca2ba-ad81-4b10-8582-3c8aea2c1887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:08.297488 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ca2ba-ad81-4b10-8582-3c8aea2c1887 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:08.308354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 968/1928] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:08.319837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:08.322925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ca2ba-ad81-4b10-8582-3c8aea2c1887 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:08.324696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:08.339536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ca2ba-ad81-4b10-8582-3c8aea2c1887 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:08.347617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ddbf9-73f9-41e7-89e5-f899064cb1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:08.348714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ddbf9-73f9-41e7-89e5-f899064cb1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.349540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ddbf9-73f9-41e7-89e5-f899064cb1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.350057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ddbf9-73f9-41e7-89e5-f899064cb1ab admin admin] PATH_INFO: `/v3/projects/c1f7060e1fda40ce9192c07d03eb3a73/users/d72bd48b4b0b45de98c75228bcb7013c/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.352810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ddbf9-73f9-41e7-89e5-f899064cb1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f7060e1fda40ce9192c07d03eb3a73, user_id=d72bd48b4b0b45de98c75228bcb7013c, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:08.358450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ddbf9-73f9-41e7-89e5-f899064cb1ab admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:08.363241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:08.366070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d94cf5-41b6-4741-b85d-e6ffd1f71681 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:08.376263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:08.376869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.377151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.377448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] PATH_INFO: `/v3/users/0e1e11e691384262af1b0696ce145f17` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.379536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1e11e691384262af1b0696ce145f17)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:08.382445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:08.404431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 969/1929] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:08 2022] PUT /identity/v3/projects/c1f7060e1fda40ce9192c07d03eb3a73/users/d72bd48b4b0b45de98c75228bcb7013c/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:08.416757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492f16b-2f0f-40b0-b706-b6621ee33083 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.417588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492f16b-2f0f-40b0-b706-b6621ee33083 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.421388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492f16b-2f0f-40b0-b706-b6621ee33083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.461349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7492f16b-2f0f-40b0-b706-b6621ee33083 None None] MFA Rules not processed for user `d72bd48b4b0b45de98c75228bcb7013c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:08.462874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7492f16b-2f0f-40b0-b706-b6621ee33083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:08.492100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1e11e691384262af1b0696ce145f17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:08.516747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1e11e691384262af1b0696ce145f17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:08.552381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1e11e691384262af1b0696ce145f17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:08.553353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1e11e691384262af1b0696ce145f17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:08.563932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d9f98bd2-acec-4d19-83d8-3641625cbbcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1e11e691384262af1b0696ce145f17'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:08.577242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 961/1930] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:08 2022] DELETE /identity/v3/users/0e1e11e691384262af1b0696ce145f17 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:08.581785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7510dc-211a-4dc5-9bf8-8012e42ff02f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.582255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7510dc-211a-4dc5-9bf8-8012e42ff02f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.582606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7510dc-211a-4dc5-9bf8-8012e42ff02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.604624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 970/1931] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:08.614736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7e7510dc-211a-4dc5-9bf8-8012e42ff02f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:08.616031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7e7510dc-211a-4dc5-9bf8-8012e42ff02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:08.616491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492f16b-2f0f-40b0-b706-b6621ee33083 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:08.617911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7492f16b-2f0f-40b0-b706-b6621ee33083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:08.694689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492f16b-2f0f-40b0-b706-b6621ee33083 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:08.697850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 962/1932] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:08.713813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7510dc-211a-4dc5-9bf8-8012e42ff02f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:08.716778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7e7510dc-211a-4dc5-9bf8-8012e42ff02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:08.737936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:08.779025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e254892-f875-409f-acb6-bc3ded90151d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:08.779325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e254892-f875-409f-acb6-bc3ded90151d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.779608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e254892-f875-409f-acb6-bc3ded90151d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.779885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e254892-f875-409f-acb6-bc3ded90151d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.789796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4e254892-f875-409f-acb6-bc3ded90151d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:08.816130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7510dc-211a-4dc5-9bf8-8012e42ff02f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:08.821983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe6d27-eff7-45ca-a52f-6494a4073501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:08.822694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6d27-eff7-45ca-a52f-6494a4073501 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:08.822992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6d27-eff7-45ca-a52f-6494a4073501 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:08.823290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6d27-eff7-45ca-a52f-6494a4073501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:08.846695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe6d27-eff7-45ca-a52f-6494a4073501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:08.848595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe6d27-eff7-45ca-a52f-6494a4073501 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:08.885852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 963/1933] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:08.935988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:08.962884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e254892-f875-409f-acb6-bc3ded90151d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:08.964710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e254892-f875-409f-acb6-bc3ded90151d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:08.977958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 971/1934] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:09.271113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff1fd-3dce-404e-b741-d4124b4d4997 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:09.271528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff1fd-3dce-404e-b741-d4124b4d4997 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:09.271740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff1fd-3dce-404e-b741-d4124b4d4997 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:09.274268 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 964/1935] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:14:09.304025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5809f6-6b20-41e7-b1cc-6dd9eb89a913 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:09.304690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5809f6-6b20-41e7-b1cc-6dd9eb89a913 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:09.304801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5809f6-6b20-41e7-b1cc-6dd9eb89a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:09.340046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff1fd-3dce-404e-b741-d4124b4d4997 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:09.342146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-da9ff1fd-3dce-404e-b741-d4124b4d4997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:09.351639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ac5809f6-6b20-41e7-b1cc-6dd9eb89a913 None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:09.373913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ac5809f6-6b20-41e7-b1cc-6dd9eb89a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:09.395484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff1fd-3dce-404e-b741-d4124b4d4997 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:09.405773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:09.408728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:09.409722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:09.410290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] PATH_INFO: `/v3/projects/f19ddcda04664ce58819f80e4cfdaa29` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:09.414544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19ddcda04664ce58819f80e4cfdaa29)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:09.425120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:09.506898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 972/1936] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:09.536009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5809f6-6b20-41e7-b1cc-6dd9eb89a913 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:09.537791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ac5809f6-6b20-41e7-b1cc-6dd9eb89a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:09.547726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19ddcda04664ce58819f80e4cfdaa29', 'request_id': 'req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.560723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19ddcda04664ce58819f80e4cfdaa29', 'request_id': 'req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.562871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5809f6-6b20-41e7-b1cc-6dd9eb89a913 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:09.570646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19ddcda04664ce58819f80e4cfdaa29', 'request_id': 'req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.594167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] The token cache is being invalidate because project f19ddcda04664ce58819f80e4cfdaa29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:09.594465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.595662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.597442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 965/1937] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:09 2022] DELETE /identity/v3/projects/f19ddcda04664ce58819f80e4cfdaa29 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:09.602436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:09.604304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:09.665656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:09.666985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:09.667366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:09.667740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:09.669831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:09.683486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:09.685249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:09.697711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 973/1938] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:09.716757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4a5de-214b-4ea0-9556-43ad8f5a7c6b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:09.723911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:09.725631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:09.726090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:09.726513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] PATH_INFO: `/v3/users/8d699b38f72c4c06a1c9b246d4a725c3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:09.728069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d699b38f72c4c06a1c9b246d4a725c3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:09.730962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:09.776787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:09.801973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d699b38f72c4c06a1c9b246d4a725c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.812595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d699b38f72c4c06a1c9b246d4a725c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.838271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d699b38f72c4c06a1c9b246d4a725c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.839787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d699b38f72c4c06a1c9b246d4a725c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.849102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0202716-fedc-4f1b-af3b-74a40cc60a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d699b38f72c4c06a1c9b246d4a725c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:09.858891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 966/1939] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:09 2022] DELETE /identity/v3/users/8d699b38f72c4c06a1c9b246d4a725c3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:10.380675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:10.396954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02e7b-e055-4697-b44d-11d9c53cea68 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:10.517560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:10.518371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:10.519104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:10.519789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] PATH_INFO: `/v3/projects/f085c0872edb47c086715e03853e16f9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:10.521859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f085c0872edb47c086715e03853e16f9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:10.524293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:10.536328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:10.606483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f085c0872edb47c086715e03853e16f9', 'request_id': 'req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:10.617381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f085c0872edb47c086715e03853e16f9', 'request_id': 'req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:10.634040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f085c0872edb47c086715e03853e16f9', 'request_id': 'req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:10.658140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] The token cache is being invalidate because project f085c0872edb47c086715e03853e16f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:10.658447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:10.659785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4fa63cf2-ec00-4b86-9f39-4a411baa7fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:10.661362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 974/1940] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:10 2022] DELETE /identity/v3/projects/f085c0872edb47c086715e03853e16f9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:10.668311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b62b-a23c-43e5-8a50-39c15f6dea96 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:10.668921 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b62b-a23c-43e5-8a50-39c15f6dea96 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:10.669307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b62b-a23c-43e5-8a50-39c15f6dea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:10.707775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2be9b62b-a23c-43e5-8a50-39c15f6dea96 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:10.708984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2be9b62b-a23c-43e5-8a50-39c15f6dea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:10.789551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 967/1941] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:10.795521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0953b-21d9-4a9a-b28a-7f1a9132092e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:10.796083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0953b-21d9-4a9a-b28a-7f1a9132092e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:10.796701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0953b-21d9-4a9a-b28a-7f1a9132092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:10.815125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9b62b-a23c-43e5-8a50-39c15f6dea96 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:10.816836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2be9b62b-a23c-43e5-8a50-39c15f6dea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:10.819059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-05a0953b-21d9-4a9a-b28a-7f1a9132092e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:10.820234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-05a0953b-21d9-4a9a-b28a-7f1a9132092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:10.829138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 975/1942] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:10.834508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0953b-21d9-4a9a-b28a-7f1a9132092e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:10.846446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0953b-21d9-4a9a-b28a-7f1a9132092e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:10.852894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:10.854084 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:10.854368 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:10.854645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:10.855303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:10.855778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:10.857535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:10.878232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 976/1943] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:10.882528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:10.896714 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f35ab-96b2-424b-9d22-414589da4556 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:10.899335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9b62b-a23c-43e5-8a50-39c15f6dea96 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:10.902656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38316-166b-447a-8e62-bb0a6d81c786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:10.903350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38316-166b-447a-8e62-bb0a6d81c786 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:10.903685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38316-166b-447a-8e62-bb0a6d81c786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:10.904031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38316-166b-447a-8e62-bb0a6d81c786 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:10.904837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d38316-166b-447a-8e62-bb0a6d81c786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:10.905463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:10.906375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:10.906903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:10.907329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d38316-166b-447a-8e62-bb0a6d81c786 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:10.907718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:10.910771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:10.966125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 977/1944] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:10 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:10.967076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38316-166b-447a-8e62-bb0a6d81c786 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.019040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.021177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.031794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 968/1945] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:11.050334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38316-166b-447a-8e62-bb0a6d81c786 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:11.055884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76b17-f0b8-4827-a0a4-661c2a7d7a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:11.056615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76b17-f0b8-4827-a0a4-661c2a7d7a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.057525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76b17-f0b8-4827-a0a4-661c2a7d7a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.057847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76b17-f0b8-4827-a0a4-661c2a7d7a30 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.058499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd76b17-f0b8-4827-a0a4-661c2a7d7a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.060608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd76b17-f0b8-4827-a0a4-661c2a7d7a30 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.090275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 978/1946] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:10 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:11.091428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.122116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c644903-5bd6-416e-8fd6-d30163256c5a service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:11.127863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef1e7-ce18-4a34-8f93-02ff74bf0252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:11.128481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef1e7-ce18-4a34-8f93-02ff74bf0252 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.128765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef1e7-ce18-4a34-8f93-02ff74bf0252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.129294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef1e7-ce18-4a34-8f93-02ff74bf0252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.130009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef1e7-ce18-4a34-8f93-02ff74bf0252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.131603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef1e7-ce18-4a34-8f93-02ff74bf0252 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.133346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:11.144785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 969/1947] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:11.149446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76b17-f0b8-4827-a0a4-661c2a7d7a30 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.161817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76b17-f0b8-4827-a0a4-661c2a7d7a30 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:11.167172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d4d6-2202-457f-8df1-e45f1fc15a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:11.167781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d4d6-2202-457f-8df1-e45f1fc15a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.168067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d4d6-2202-457f-8df1-e45f1fc15a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.168360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d4d6-2202-457f-8df1-e45f1fc15a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.169034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670d4d6-2202-457f-8df1-e45f1fc15a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.170739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670d4d6-2202-457f-8df1-e45f1fc15a02 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.180956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 979/1948] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:11.185227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef1e7-ce18-4a34-8f93-02ff74bf0252 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.196281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef1e7-ce18-4a34-8f93-02ff74bf0252 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:11.201813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e6459-696c-4b34-8262-6d1052909f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:11.202476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6459-696c-4b34-8262-6d1052909f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.202760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6459-696c-4b34-8262-6d1052909f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.203038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6459-696c-4b34-8262-6d1052909f23 admin admin] PATH_INFO: `/v3/projects/a4b7b053638d49baa791398f928cdc74/users/cd2ed2582bbe4a739f7f97b8c27bf873/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.220137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e6459-696c-4b34-8262-6d1052909f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b7b053638d49baa791398f928cdc74, user_id=cd2ed2582bbe4a739f7f97b8c27bf873, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.222883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e6459-696c-4b34-8262-6d1052909f23 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.236598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 970/1949] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:11 2022] PUT /identity/v3/projects/a4b7b053638d49baa791398f928cdc74/users/cd2ed2582bbe4a739f7f97b8c27bf873/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:11.247078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a114-9fba-43f1-80c7-fbed65913514 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.247400 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a114-9fba-43f1-80c7-fbed65913514 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.247690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a114-9fba-43f1-80c7-fbed65913514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.277520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d6c0a114-9fba-43f1-80c7-fbed65913514 None None] MFA Rules not processed for user `cd2ed2582bbe4a739f7f97b8c27bf873`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:11.278761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d6c0a114-9fba-43f1-80c7-fbed65913514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:11.307977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:11.368458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 980/1950] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:11.373207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e6459-696c-4b34-8262-6d1052909f23 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.488607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0a114-9fba-43f1-80c7-fbed65913514 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.490201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d6c0a114-9fba-43f1-80c7-fbed65913514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:11.494367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e6459-696c-4b34-8262-6d1052909f23 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:11.507063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccce63-ca19-40d9-b981-d39fd21be454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:11.508679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccce63-ca19-40d9-b981-d39fd21be454 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.508971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccce63-ca19-40d9-b981-d39fd21be454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.509246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccce63-ca19-40d9-b981-d39fd21be454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.511046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccce63-ca19-40d9-b981-d39fd21be454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.516317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccce63-ca19-40d9-b981-d39fd21be454 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.520379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0a114-9fba-43f1-80c7-fbed65913514 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:11.530541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:11.531764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.532317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.532836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] PATH_INFO: `/v3/users/a3d1af9c8d1849069ffdb44d525ee1ac` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.535846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d1af9c8d1849069ffdb44d525ee1ac)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.540704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.590812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 971/1951] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:11 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:11.599752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccce63-ca19-40d9-b981-d39fd21be454 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.658233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d1af9c8d1849069ffdb44d525ee1ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:11.711204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d1af9c8d1849069ffdb44d525ee1ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:11.722981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccce63-ca19-40d9-b981-d39fd21be454 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:11.731182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d1af9c8d1849069ffdb44d525ee1ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:11.731750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d1af9c8d1849069ffdb44d525ee1ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:11.737623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:11.739477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.745831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.746238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.747104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.749348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.759237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2f53d9b7-43fb-4601-a1b2-6ca60451da5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d1af9c8d1849069ffdb44d525ee1ac'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:11.772482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 981/1952] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:11 2022] DELETE /identity/v3/users/a3d1af9c8d1849069ffdb44d525ee1ac => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:11.782922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffd44-0f60-4358-9301-05835b386632 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.782922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffd44-0f60-4358-9301-05835b386632 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.782922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffd44-0f60-4358-9301-05835b386632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.825695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 972/1953] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:11 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:11.830825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.832986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:11.839537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-55dffd44-0f60-4358-9301-05835b386632 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:11.841087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-55dffd44-0f60-4358-9301-05835b386632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:11.862987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c8b8-36a4-44fe-a77e-ad9f466436b4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:11.919906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:11.939653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 982/1954] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:11.939826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:11.940659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:11.940801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:11.940891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dffd44-0f60-4358-9301-05835b386632 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.941142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:11.941893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:11.942744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-55dffd44-0f60-4358-9301-05835b386632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:11.943881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:11.957461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 973/1955] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:11.957461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:11.959666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:11.998504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:12.065464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254b227-4e42-4bb4-a37b-f543d5ee9ded admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.069035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dffd44-0f60-4358-9301-05835b386632 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.071281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e69c-e1f7-4218-95fc-98f017685314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.072079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e69c-e1f7-4218-95fc-98f017685314 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.072899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e69c-e1f7-4218-95fc-98f017685314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.073206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e69c-e1f7-4218-95fc-98f017685314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.074846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.075715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.076465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.076900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.079077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:12.084154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59e69c-e1f7-4218-95fc-98f017685314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.087234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59e69c-e1f7-4218-95fc-98f017685314 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.098725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 974/1956] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:12.099609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e69c-e1f7-4218-95fc-98f017685314 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:12.109945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e69c-e1f7-4218-95fc-98f017685314 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.117293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90c0b-08ac-4a60-8aca-8d35f9f0a9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.118475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90c0b-08ac-4a60-8aca-8d35f9f0a9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.118475 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90c0b-08ac-4a60-8aca-8d35f9f0a9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.118735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90c0b-08ac-4a60-8aca-8d35f9f0a9ad admin admin] PATH_INFO: `/v3/projects/c1421da16e6f4ac0b6f5682915747816/users/848527b36d1a495188376cb2f257cff5/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.145836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e90c0b-08ac-4a60-8aca-8d35f9f0a9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1421da16e6f4ac0b6f5682915747816, user_id=848527b36d1a495188376cb2f257cff5, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.149886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e90c0b-08ac-4a60-8aca-8d35f9f0a9ad admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.163600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.165120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.176554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 975/1957] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:12 2022] PUT /identity/v3/projects/c1421da16e6f4ac0b6f5682915747816/users/848527b36d1a495188376cb2f257cff5/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:12.177587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 983/1958] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:12.181213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90c0b-08ac-4a60-8aca-8d35f9f0a9ad admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:12.270058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90c0b-08ac-4a60-8aca-8d35f9f0a9ad admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.275718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e4056-c4c1-4c09-b587-f02e49503996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.276606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4056-c4c1-4c09-b587-f02e49503996 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.276772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4056-c4c1-4c09-b587-f02e49503996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.277117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4056-c4c1-4c09-b587-f02e49503996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.277847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e4056-c4c1-4c09-b587-f02e49503996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.280006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e4056-c4c1-4c09-b587-f02e49503996 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.294952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 976/1959] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:12.298136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:12.312945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f350547-1d12-414f-92a0-bea26431aa0a service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.317862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d33b6-b5d6-4280-80cc-8955f069126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.318556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d33b6-b5d6-4280-80cc-8955f069126e admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.318802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d33b6-b5d6-4280-80cc-8955f069126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.319073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d33b6-b5d6-4280-80cc-8955f069126e admin admin] PATH_INFO: `/v3/projects/c1421da16e6f4ac0b6f5682915747816/users/848527b36d1a495188376cb2f257cff5/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.320987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d33b6-b5d6-4280-80cc-8955f069126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1421da16e6f4ac0b6f5682915747816, user_id=848527b36d1a495188376cb2f257cff5, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.324406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d33b6-b5d6-4280-80cc-8955f069126e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.338690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 984/1960] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:12 2022] PUT /identity/v3/projects/c1421da16e6f4ac0b6f5682915747816/users/848527b36d1a495188376cb2f257cff5/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:12.350356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca207b-8c26-4d91-9cab-23b45e42344b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.350645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca207b-8c26-4d91-9cab-23b45e42344b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.350920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca207b-8c26-4d91-9cab-23b45e42344b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.382457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7cca207b-8c26-4d91-9cab-23b45e42344b None None] MFA Rules not processed for user `848527b36d1a495188376cb2f257cff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:12.383674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7cca207b-8c26-4d91-9cab-23b45e42344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:12.433448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:12.460979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 977/1961] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:12.472276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d33b6-b5d6-4280-80cc-8955f069126e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:12.533011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d33b6-b5d6-4280-80cc-8955f069126e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.537189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfbeec-6c5b-4bc2-91a0-d0582ff4f654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.537905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfbeec-6c5b-4bc2-91a0-d0582ff4f654 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.538253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfbeec-6c5b-4bc2-91a0-d0582ff4f654 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.538596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfbeec-6c5b-4bc2-91a0-d0582ff4f654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.544280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca207b-8c26-4d91-9cab-23b45e42344b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:12.545776 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7cca207b-8c26-4d91-9cab-23b45e42344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:12.551421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfbeec-6c5b-4bc2-91a0-d0582ff4f654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.553034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfbeec-6c5b-4bc2-91a0-d0582ff4f654 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.564136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 985/1962] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:12.627303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca207b-8c26-4d91-9cab-23b45e42344b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.632356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.633039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.633261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.633575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] PATH_INFO: `/v3/projects/1c5136115c7e482e9ca9659ea0c57207` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.634679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5136115c7e482e9ca9659ea0c57207)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.636703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.671312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfbeec-6c5b-4bc2-91a0-d0582ff4f654 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:12.679931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfbeec-6c5b-4bc2-91a0-d0582ff4f654 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.688804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5136115c7e482e9ca9659ea0c57207', 'request_id': 'req-79454c66-f42d-4e97-8201-f69046335320'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:12.694779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5136115c7e482e9ca9659ea0c57207', 'request_id': 'req-79454c66-f42d-4e97-8201-f69046335320'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:12.701162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5136115c7e482e9ca9659ea0c57207', 'request_id': 'req-79454c66-f42d-4e97-8201-f69046335320'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:12.716574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] The token cache is being invalidate because project 1c5136115c7e482e9ca9659ea0c57207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:12.716862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:12.717536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79454c66-f42d-4e97-8201-f69046335320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:12.719040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 978/1963] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:12 2022] DELETE /identity/v3/projects/1c5136115c7e482e9ca9659ea0c57207 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:12.723675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb42f-8c27-4064-abdd-745b4a53ec29 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.724216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb42f-8c27-4064-abdd-745b4a53ec29 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.724216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb42f-8c27-4064-abdd-745b4a53ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.738195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.739226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.739602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.739918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.742195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:12.744336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d0abb42f-8c27-4064-abdd-745b4a53ec29 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:12.745524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d0abb42f-8c27-4064-abdd-745b4a53ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:12.774345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:12.811293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 979/1964] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:12.817471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.819103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fc79a-f8be-48be-8518-804b28c54048 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.819358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.821387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fc79a-f8be-48be-8518-804b28c54048 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.821994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fc79a-f8be-48be-8518-804b28c54048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.831093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 986/1965] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:12.849950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3e5fc79a-f8be-48be-8518-804b28c54048 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:12.851225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3e5fc79a-f8be-48be-8518-804b28c54048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:12.860676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 980/1966] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:12.864949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:12.877081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b3778-142c-4027-a714-3f52dda98b5f service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.883386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.883932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.884283 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.885297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.886049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:12.886485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.888162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.901457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 987/1967] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:12.905294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fc79a-f8be-48be-8518-804b28c54048 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:12.919038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fc79a-f8be-48be-8518-804b28c54048 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:12.926509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b40f3-0574-4a2b-99ee-f297553b3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:12.927342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b40f3-0574-4a2b-99ee-f297553b3b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:12.928009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b40f3-0574-4a2b-99ee-f297553b3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:12.928457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b40f3-0574-4a2b-99ee-f297553b3b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:12.941844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b40f3-0574-4a2b-99ee-f297553b3b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:12.946184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b40f3-0574-4a2b-99ee-f297553b3b8c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:12.958751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:13.008679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 981/1968] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:12 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:13.013374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:13.048698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcb1e6-561a-4968-95ad-8f69bf6e9f61 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:13.188185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bad246-bbdd-4da2-b224-725d40c1310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:13.189183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bad246-bbdd-4da2-b224-725d40c1310b admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:13.189611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bad246-bbdd-4da2-b224-725d40c1310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:13.189989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bad246-bbdd-4da2-b224-725d40c1310b admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:13.190735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bad246-bbdd-4da2-b224-725d40c1310b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:13.192948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bad246-bbdd-4da2-b224-725d40c1310b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:13.225913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 988/1969] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:13 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:13.226504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b40f3-0574-4a2b-99ee-f297553b3b8c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:13.245106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b40f3-0574-4a2b-99ee-f297553b3b8c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:13.261572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11205d63-a178-44a3-b5a7-f5378546f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:13.263131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11205d63-a178-44a3-b5a7-f5378546f359 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:13.263592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11205d63-a178-44a3-b5a7-f5378546f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:13.263960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11205d63-a178-44a3-b5a7-f5378546f359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:13.265092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11205d63-a178-44a3-b5a7-f5378546f359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:13.267554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11205d63-a178-44a3-b5a7-f5378546f359 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:13.284620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 982/1970] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:13.295234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bad246-bbdd-4da2-b224-725d40c1310b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:13.311301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bad246-bbdd-4da2-b224-725d40c1310b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:13.318684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ef915-c104-4dad-89f5-72b7acb0e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:13.319737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ef915-c104-4dad-89f5-72b7acb0e62d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:13.320230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ef915-c104-4dad-89f5-72b7acb0e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:13.320993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ef915-c104-4dad-89f5-72b7acb0e62d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:13.321808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ef915-c104-4dad-89f5-72b7acb0e62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:13.325023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ef915-c104-4dad-89f5-72b7acb0e62d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:13.344321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 989/1971] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:13.344581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11205d63-a178-44a3-b5a7-f5378546f359 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:13.373439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11205d63-a178-44a3-b5a7-f5378546f359 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:13.386714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc832c-c863-4217-bc94-d5cc7abca4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:13.387333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc832c-c863-4217-bc94-d5cc7abca4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:13.387665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc832c-c863-4217-bc94-d5cc7abca4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:13.387939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc832c-c863-4217-bc94-d5cc7abca4b9 admin admin] PATH_INFO: `/v3/projects/0652676dbe68486b8d0d9884056cb4f5/users/c7c441156ef342a597c676618f6e5d33/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:13.414005 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc832c-c863-4217-bc94-d5cc7abca4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0652676dbe68486b8d0d9884056cb4f5, user_id=c7c441156ef342a597c676618f6e5d33, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:13.418057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc832c-c863-4217-bc94-d5cc7abca4b9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:13.444706 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 983/1972] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:13 2022] PUT /identity/v3/projects/0652676dbe68486b8d0d9884056cb4f5/users/c7c441156ef342a597c676618f6e5d33/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:13.455864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442986b1-ea2d-46e9-8cb7-1b76f07eeccb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:13.456369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442986b1-ea2d-46e9-8cb7-1b76f07eeccb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:13.460107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442986b1-ea2d-46e9-8cb7-1b76f07eeccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:13.552729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-442986b1-ea2d-46e9-8cb7-1b76f07eeccb None None] MFA Rules not processed for user `c7c441156ef342a597c676618f6e5d33`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:13.552729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-442986b1-ea2d-46e9-8cb7-1b76f07eeccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:13.674871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 990/1973] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:13.676824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc832c-c863-4217-bc94-d5cc7abca4b9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:13.772699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc832c-c863-4217-bc94-d5cc7abca4b9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:13.780182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadc3e5-eb8e-41d9-ade5-03314c447ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:13.781150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc3e5-eb8e-41d9-ade5-03314c447ace admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:13.782950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc3e5-eb8e-41d9-ade5-03314c447ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:13.783247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc3e5-eb8e-41d9-ade5-03314c447ace admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:13.784256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadc3e5-eb8e-41d9-ade5-03314c447ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:13.790204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadc3e5-eb8e-41d9-ade5-03314c447ace admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:13.829981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 984/1974] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:13 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:13.834307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442986b1-ea2d-46e9-8cb7-1b76f07eeccb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:13.850240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442986b1-ea2d-46e9-8cb7-1b76f07eeccb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:13.881653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:13.944032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49b53c-e640-43de-9f4d-373a3fbc39cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:13.944814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b53c-e640-43de-9f4d-373a3fbc39cc admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:13.945239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b53c-e640-43de-9f4d-373a3fbc39cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:13.945752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b53c-e640-43de-9f4d-373a3fbc39cc admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:13.946672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49b53c-e640-43de-9f4d-373a3fbc39cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:13.949600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49b53c-e640-43de-9f4d-373a3fbc39cc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:13.977443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 991/1975] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:13 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:13.980098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadc3e5-eb8e-41d9-ade5-03314c447ace admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:13.991986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadc3e5-eb8e-41d9-ade5-03314c447ace admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:13.998124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80766b2-a039-4315-839c-4408f05b8ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:13.998836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80766b2-a039-4315-839c-4408f05b8ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:13.999189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80766b2-a039-4315-839c-4408f05b8ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:13.999536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80766b2-a039-4315-839c-4408f05b8ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:14.000252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80766b2-a039-4315-839c-4408f05b8ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:14.002090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80766b2-a039-4315-839c-4408f05b8ab7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:14.014007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 985/1976] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:14.018250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49b53c-e640-43de-9f4d-373a3fbc39cc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:14.028385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49b53c-e640-43de-9f4d-373a3fbc39cc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:14.033143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f8f7-e723-4820-ba8d-8250433a6a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:14.033874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f8f7-e723-4820-ba8d-8250433a6a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:14.034160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f8f7-e723-4820-ba8d-8250433a6a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:14.034435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f8f7-e723-4820-ba8d-8250433a6a14 admin admin] PATH_INFO: `/v3/projects/4e2b138c2ddb439a8f00f7c77919b85a/users/af3ec4b469a64e48b5b68a960967999e/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:14.050680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1f8f7-e723-4820-ba8d-8250433a6a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2b138c2ddb439a8f00f7c77919b85a, user_id=af3ec4b469a64e48b5b68a960967999e, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:14.053346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1f8f7-e723-4820-ba8d-8250433a6a14 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:14.067323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 992/1977] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:14 2022] PUT /identity/v3/projects/4e2b138c2ddb439a8f00f7c77919b85a/users/af3ec4b469a64e48b5b68a960967999e/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:14.071854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80766b2-a039-4315-839c-4408f05b8ab7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:14.083467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80766b2-a039-4315-839c-4408f05b8ab7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:14.164910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbd961-af7b-4400-87cc-0d43d9dfdc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:14.166787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbd961-af7b-4400-87cc-0d43d9dfdc89 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:14.167396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbd961-af7b-4400-87cc-0d43d9dfdc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:14.167678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbd961-af7b-4400-87cc-0d43d9dfdc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:14.168332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbd961-af7b-4400-87cc-0d43d9dfdc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:14.170083 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbd961-af7b-4400-87cc-0d43d9dfdc89 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:14.180905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 986/1978] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:14.185721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f8f7-e723-4820-ba8d-8250433a6a14 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:14.201005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f8f7-e723-4820-ba8d-8250433a6a14 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:14.206314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:14.207170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:14.207448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:14.207847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] PATH_INFO: `/v3/projects/4e2b138c2ddb439a8f00f7c77919b85a/users/af3ec4b469a64e48b5b68a960967999e/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:14.209813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2b138c2ddb439a8f00f7c77919b85a, user_id=af3ec4b469a64e48b5b68a960967999e, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:14.212443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:14.224736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 993/1979] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:14 2022] PUT /identity/v3/projects/4e2b138c2ddb439a8f00f7c77919b85a/users/af3ec4b469a64e48b5b68a960967999e/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:14.234932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c749a-88a7-4f71-8d13-649670cf7883 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:14.235223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c749a-88a7-4f71-8d13-649670cf7883 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:14.235499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c749a-88a7-4f71-8d13-649670cf7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:14.267576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-067c749a-88a7-4f71-8d13-649670cf7883 None None] MFA Rules not processed for user `af3ec4b469a64e48b5b68a960967999e`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:14.268795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-067c749a-88a7-4f71-8d13-649670cf7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:14.277878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:14.342027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 987/1980] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:14.353979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:14.356388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:14.421684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c90d9-2d1a-4bd1-a5de-b9ef05311764 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:14.425249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf1ff-d015-4ef0-b6ea-0735bfaebaf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:14.425893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf1ff-d015-4ef0-b6ea-0735bfaebaf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:14.426174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf1ff-d015-4ef0-b6ea-0735bfaebaf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:14.426446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf1ff-d015-4ef0-b6ea-0735bfaebaf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:14.484715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf1ff-d015-4ef0-b6ea-0735bfaebaf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:14.486173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf1ff-d015-4ef0-b6ea-0735bfaebaf4 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:14.495597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 994/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:15.693381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c749a-88a7-4f71-8d13-649670cf7883 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:15.694891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-067c749a-88a7-4f71-8d13-649670cf7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:15.770197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c749a-88a7-4f71-8d13-649670cf7883 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:15.775828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:15.776470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:15.776750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:15.777020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] PATH_INFO: `/v3/users/cd2ed2582bbe4a739f7f97b8c27bf873` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:15.778197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2ed2582bbe4a739f7f97b8c27bf873)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:15.780142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:15.835099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2ed2582bbe4a739f7f97b8c27bf873'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:15.844968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2ed2582bbe4a739f7f97b8c27bf873'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:15.860020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2ed2582bbe4a739f7f97b8c27bf873'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:15.860722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2ed2582bbe4a739f7f97b8c27bf873'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:15.868375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2ed2582bbe4a739f7f97b8c27bf873'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:15.874716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 988/1982] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:15 2022] DELETE /identity/v3/users/cd2ed2582bbe4a739f7f97b8c27bf873 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:15.879409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005b78-880a-4f66-80fc-b4dc81d27edf None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:15.879872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005b78-880a-4f66-80fc-b4dc81d27edf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:15.880059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8005b78-880a-4f66-80fc-b4dc81d27edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:15.899747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a8005b78-880a-4f66-80fc-b4dc81d27edf None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:15.901663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a8005b78-880a-4f66-80fc-b4dc81d27edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:15.929538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:15.972295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 995/1983] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:15.983375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:15.986145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:16.036710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:16.076710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc83a79-8e29-49d1-83b7-54b741a4e1a4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:16.080527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:16.081150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:16.081798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:16.081798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:16.106178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:16.107862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:16.119405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 989/1984] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:16.463680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8005b78-880a-4f66-80fc-b4dc81d27edf None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:16.472800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a8005b78-880a-4f66-80fc-b4dc81d27edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:16.498685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8005b78-880a-4f66-80fc-b4dc81d27edf None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:16.507314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:16.507969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:16.508252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:16.508530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] PATH_INFO: `/v3/projects/a4b7b053638d49baa791398f928cdc74` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:16.512189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b7b053638d49baa791398f928cdc74)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:16.512928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:16.543331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:16.549581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:16.564703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0b70a-ac1b-4e61-bf75-44b85b59be92 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:16.574251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:16.575030 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:16.575431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:16.576007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] PATH_INFO: `/v3/users/6fd03b9ee1374bc99a5fd5b41dbaf4d9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:16.578115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd03b9ee1374bc99a5fd5b41dbaf4d9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:16.580417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:16.601056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b7b053638d49baa791398f928cdc74', 'request_id': 'req-29017598-de15-4f02-b86a-8aa42f2cf576'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.623750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b7b053638d49baa791398f928cdc74', 'request_id': 'req-29017598-de15-4f02-b86a-8aa42f2cf576'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.633317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b7b053638d49baa791398f928cdc74', 'request_id': 'req-29017598-de15-4f02-b86a-8aa42f2cf576'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.660049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] The token cache is being invalidate because project a4b7b053638d49baa791398f928cdc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:16.660377 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.662550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.662671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd03b9ee1374bc99a5fd5b41dbaf4d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.667561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 996/1985] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:16 2022] DELETE /identity/v3/projects/a4b7b053638d49baa791398f928cdc74 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:16.669227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:16.671557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:16.676407 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd03b9ee1374bc99a5fd5b41dbaf4d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.699131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd03b9ee1374bc99a5fd5b41dbaf4d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.700574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd03b9ee1374bc99a5fd5b41dbaf4d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.711851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9fc1c232-dd49-43bf-b47a-bc5dde145140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd03b9ee1374bc99a5fd5b41dbaf4d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.722338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 990/1986] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:16 2022] DELETE /identity/v3/users/6fd03b9ee1374bc99a5fd5b41dbaf4d9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:16.726938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82934c58-6b0f-40f9-88f0-ef80bfafabf1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:16.727300 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82934c58-6b0f-40f9-88f0-ef80bfafabf1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:16.727751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82934c58-6b0f-40f9-88f0-ef80bfafabf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:16.751943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-82934c58-6b0f-40f9-88f0-ef80bfafabf1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:16.754751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-82934c58-6b0f-40f9-88f0-ef80bfafabf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:16.793608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29017598-de15-4f02-b86a-8aa42f2cf576 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:16.868562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:16.869354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:16.869734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:16.870081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] PATH_INFO: `/v3/users/848527b36d1a495188376cb2f257cff5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:16.871390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=848527b36d1a495188376cb2f257cff5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:16.875208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:16.877757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:16.879575 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 991/1987] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:16.891631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82934c58-6b0f-40f9-88f0-ef80bfafabf1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:16.893573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-82934c58-6b0f-40f9-88f0-ef80bfafabf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:16.974592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848527b36d1a495188376cb2f257cff5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:16.977044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:17.008367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82934c58-6b0f-40f9-88f0-ef80bfafabf1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:17.010882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848527b36d1a495188376cb2f257cff5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.013922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:17.015337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:17.016076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:17.016528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:17.027068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848527b36d1a495188376cb2f257cff5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.027636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:17.027858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848527b36d1a495188376cb2f257cff5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.029158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:17.037917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848527b36d1a495188376cb2f257cff5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.041708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 992/1988] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:17.045106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 997/1989] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:16 2022] DELETE /identity/v3/users/848527b36d1a495188376cb2f257cff5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:17.294483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:17.295489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:17.326174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1aa5-50e6-43ed-82d2-c12e26550d65 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:17.481425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:17.482388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:17.482890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:17.483262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] PATH_INFO: `/v3/users/c7c441156ef342a597c676618f6e5d33` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:17.485341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c441156ef342a597c676618f6e5d33)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:17.490227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:17.546354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:17.548420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:17.564807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ab4d-13a2-4223-b7a0-bc9d497daffc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:17.573364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:17.574040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:17.574330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:17.574613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] PATH_INFO: `/v3/projects/a658b81477194c7b9640d54c4e3a406c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:17.581810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a658b81477194c7b9640d54c4e3a406c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:17.583830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:17.594338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c441156ef342a597c676618f6e5d33'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.606209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c441156ef342a597c676618f6e5d33'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.646772 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c441156ef342a597c676618f6e5d33'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.647819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c441156ef342a597c676618f6e5d33'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.658488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c441156ef342a597c676618f6e5d33'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.665612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 993/1990] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:17 2022] DELETE /identity/v3/users/c7c441156ef342a597c676618f6e5d33 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:17.666608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:17.668334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:17.715090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a658b81477194c7b9640d54c4e3a406c', 'request_id': 'req-1be2ff09-c96b-4543-af18-67831c8c6d63'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.731764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a658b81477194c7b9640d54c4e3a406c', 'request_id': 'req-1be2ff09-c96b-4543-af18-67831c8c6d63'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.743828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a658b81477194c7b9640d54c4e3a406c', 'request_id': 'req-1be2ff09-c96b-4543-af18-67831c8c6d63'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.758956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] The token cache is being invalidate because project a658b81477194c7b9640d54c4e3a406c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:17.760487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.762021 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1be2ff09-c96b-4543-af18-67831c8c6d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.762363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f377db4-706d-4834-8e3b-6b1e21a6865f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:17.765780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 998/1991] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:17 2022] DELETE /identity/v3/projects/a658b81477194c7b9640d54c4e3a406c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:17.768269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b5bc4-958c-4da3-9d0e-877860f1e8a6 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:17.768706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b5bc4-958c-4da3-9d0e-877860f1e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:17.769345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b5bc4-958c-4da3-9d0e-877860f1e8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:17.770440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:17.771204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:17.771712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:17.772085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] PATH_INFO: `/v3/projects/c1421da16e6f4ac0b6f5682915747816` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:17.773343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1421da16e6f4ac0b6f5682915747816)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:17.775540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:17.778984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:17.799999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f67b5bc4-958c-4da3-9d0e-877860f1e8a6 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:17.802341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f67b5bc4-958c-4da3-9d0e-877860f1e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:17.823742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 999/1992] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:17.824955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b5bc4-958c-4da3-9d0e-877860f1e8a6 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:17.827475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f67b5bc4-958c-4da3-9d0e-877860f1e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:17.841247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1421da16e6f4ac0b6f5682915747816', 'request_id': 'req-3c335c8a-a879-4572-b0bc-51ce09c1d576'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.842697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b5bc4-958c-4da3-9d0e-877860f1e8a6 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:17.850415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1421da16e6f4ac0b6f5682915747816', 'request_id': 'req-3c335c8a-a879-4572-b0bc-51ce09c1d576'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.861661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1421da16e6f4ac0b6f5682915747816', 'request_id': 'req-3c335c8a-a879-4572-b0bc-51ce09c1d576'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.884029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] The token cache is being invalidate because project c1421da16e6f4ac0b6f5682915747816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:17.885715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.887623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:17.893484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 994/1993] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:17 2022] DELETE /identity/v3/projects/c1421da16e6f4ac0b6f5682915747816 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:17.896941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:17.907566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:17.936901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:17.947494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:17.948343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:17.948862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:17.949740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] PATH_INFO: `/v3/users/86dadbd19f104c4f8561fd7e344e4f83` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:17.952154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=86dadbd19f104c4f8561fd7e344e4f83)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:17.958908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.015169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c335c8a-a879-4572-b0bc-51ce09c1d576 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:18.035163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e02d98-f829-46bc-9a00-9f9ae7762116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:18.035915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02d98-f829-46bc-9a00-9f9ae7762116 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.039881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02d98-f829-46bc-9a00-9f9ae7762116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.040396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02d98-f829-46bc-9a00-9f9ae7762116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.046076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-69e02d98-f829-46bc-9a00-9f9ae7762116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:18.060392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86dadbd19f104c4f8561fd7e344e4f83'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:18.084313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e02d98-f829-46bc-9a00-9f9ae7762116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:18.086539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86dadbd19f104c4f8561fd7e344e4f83'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:18.087238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e02d98-f829-46bc-9a00-9f9ae7762116 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.099335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86dadbd19f104c4f8561fd7e344e4f83'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:18.101818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86dadbd19f104c4f8561fd7e344e4f83'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:18.117580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 995/1994] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:18.125207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419ee6-ed46-44fa-9d9d-45186aa5b77b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.125540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419ee6-ed46-44fa-9d9d-45186aa5b77b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.125822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05419ee6-ed46-44fa-9d9d-45186aa5b77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.133044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8f2fb3d5-b082-41d0-a434-87584d38fdbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86dadbd19f104c4f8561fd7e344e4f83'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:18.156666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1000/1995] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:17 2022] DELETE /identity/v3/users/86dadbd19f104c4f8561fd7e344e4f83 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:18.170376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-05419ee6-ed46-44fa-9d9d-45186aa5b77b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:18.171963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-05419ee6-ed46-44fa-9d9d-45186aa5b77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:18.332260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 996/1996] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:18.341685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2da77d-96f0-4637-abb2-05a41e9cdd0a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.342137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2da77d-96f0-4637-abb2-05a41e9cdd0a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.342450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2da77d-96f0-4637-abb2-05a41e9cdd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.374233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8e2da77d-96f0-4637-abb2-05a41e9cdd0a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:18.376253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8e2da77d-96f0-4637-abb2-05a41e9cdd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:18.410696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05419ee6-ed46-44fa-9d9d-45186aa5b77b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:18.415978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1001/1997] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:18.426773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05419ee6-ed46-44fa-9d9d-45186aa5b77b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:18.436877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:18.438213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.439583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.439964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.440894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:18.441351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:18.444377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.463556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2da77d-96f0-4637-abb2-05a41e9cdd0a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:18.473580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 997/1998] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:14:18.481169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2da77d-96f0-4637-abb2-05a41e9cdd0a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:18.489698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0da4b-8404-4f7a-a76b-ac775d69a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:18.490339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0da4b-8404-4f7a-a76b-ac775d69a199 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.490622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0da4b-8404-4f7a-a76b-ac775d69a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.490914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0da4b-8404-4f7a-a76b-ac775d69a199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.491602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0da4b-8404-4f7a-a76b-ac775d69a199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:18.495095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0da4b-8404-4f7a-a76b-ac775d69a199 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.552700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1002/1999] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:18 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:18.557748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:18.569389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f8ff7-55f4-40f0-b264-42279d09613f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:18.601223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:18.690841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54bf0f-dfcd-4489-997a-864818840b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:18.691574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54bf0f-dfcd-4489-997a-864818840b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.691925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54bf0f-dfcd-4489-997a-864818840b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.692272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54bf0f-dfcd-4489-997a-864818840b32 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.692997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54bf0f-dfcd-4489-997a-864818840b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:18.695268 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54bf0f-dfcd-4489-997a-864818840b32 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.736681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0da4b-8404-4f7a-a76b-ac775d69a199 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:18.746281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 998/2000] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:18 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:18.765484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0da4b-8404-4f7a-a76b-ac775d69a199 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:18.771225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e939c7-184d-4cc5-9015-ebcecec7606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:18.771225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e939c7-184d-4cc5-9015-ebcecec7606d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.771225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e939c7-184d-4cc5-9015-ebcecec7606d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.771225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e939c7-184d-4cc5-9015-ebcecec7606d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.771565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e939c7-184d-4cc5-9015-ebcecec7606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:18.773091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e939c7-184d-4cc5-9015-ebcecec7606d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.800225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1003/2001] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:18.801505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54bf0f-dfcd-4489-997a-864818840b32 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:18.815423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54bf0f-dfcd-4489-997a-864818840b32 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:18.831583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:18.832215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.832499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.832858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.836093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:18.840867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.865605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 999/2002] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:18.870318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e939c7-184d-4cc5-9015-ebcecec7606d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:18.897159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e939c7-184d-4cc5-9015-ebcecec7606d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:18.897795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:18.900280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:18.905333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df358e-6b2d-4af6-82cf-41a3c468e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:18.907343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df358e-6b2d-4af6-82cf-41a3c468e016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.908347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df358e-6b2d-4af6-82cf-41a3c468e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.908743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df358e-6b2d-4af6-82cf-41a3c468e016 admin admin] PATH_INFO: `/v3/projects/675225c67ae94ffdb8d5b615ad5edac7/users/b2432880be5e4837be5ed32809e8996f/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.929341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e159e-38bd-4b4a-ba55-44fdb52813b3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:18.938636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df358e-6b2d-4af6-82cf-41a3c468e016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675225c67ae94ffdb8d5b615ad5edac7, user_id=b2432880be5e4837be5ed32809e8996f, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:18.941844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:18.942870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.943531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.943986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] PATH_INFO: `/v3/projects/0652676dbe68486b8d0d9884056cb4f5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:18.944530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df358e-6b2d-4af6-82cf-41a3c468e016 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.946611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0652676dbe68486b8d0d9884056cb4f5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:18.949314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:18.970285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1004/2003] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:18 2022] PUT /identity/v3/projects/675225c67ae94ffdb8d5b615ad5edac7/users/b2432880be5e4837be5ed32809e8996f/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:18.984808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3cdd4-977d-4b01-afd7-b995b7941ce8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:18.985131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3cdd4-977d-4b01-afd7-b995b7941ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:18.985435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3cdd4-977d-4b01-afd7-b995b7941ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:19.025268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-97b3cdd4-977d-4b01-afd7-b995b7941ce8 None None] MFA Rules not processed for user `b2432880be5e4837be5ed32809e8996f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:19.027213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-97b3cdd4-977d-4b01-afd7-b995b7941ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:19.059948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0652676dbe68486b8d0d9884056cb4f5', 'request_id': 'req-2956b328-dbd8-4906-a9bf-f146b3e8a29d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.076019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0652676dbe68486b8d0d9884056cb4f5', 'request_id': 'req-2956b328-dbd8-4906-a9bf-f146b3e8a29d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.083486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0652676dbe68486b8d0d9884056cb4f5', 'request_id': 'req-2956b328-dbd8-4906-a9bf-f146b3e8a29d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.098914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] The token cache is being invalidate because project 0652676dbe68486b8d0d9884056cb4f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:19.099351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.100324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.105373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1000/2004] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:18 2022] DELETE /identity/v3/projects/0652676dbe68486b8d0d9884056cb4f5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:19.105373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:19.105373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:19.192887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1005/2005] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:19.194071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3cdd4-977d-4b01-afd7-b995b7941ce8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:19.195957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-97b3cdd4-977d-4b01-afd7-b995b7941ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:19.202544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:19.295236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956b328-dbd8-4906-a9bf-f146b3e8a29d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:19.300638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:19.301365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:19.301755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:19.302126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] PATH_INFO: `/v3/projects/ce9392dff70048499a669777971b782c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:19.303491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9392dff70048499a669777971b782c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:19.305571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:19.311260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3cdd4-977d-4b01-afd7-b995b7941ce8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:19.316721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:19.317452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:19.317825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:19.318055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] PATH_INFO: `/v3/users/af3ec4b469a64e48b5b68a960967999e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:19.319271 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3ec4b469a64e48b5b68a960967999e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:19.321503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:19.351322 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:19.376605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3ec4b469a64e48b5b68a960967999e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.384403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9392dff70048499a669777971b782c', 'request_id': 'req-a1d63c10-9a70-42d9-b311-eef6a385fbde'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.390649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9392dff70048499a669777971b782c', 'request_id': 'req-a1d63c10-9a70-42d9-b311-eef6a385fbde'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.395652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3ec4b469a64e48b5b68a960967999e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.398090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9392dff70048499a669777971b782c', 'request_id': 'req-a1d63c10-9a70-42d9-b311-eef6a385fbde'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.405937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3ec4b469a64e48b5b68a960967999e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.406603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3ec4b469a64e48b5b68a960967999e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.415051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] The token cache is being invalidate because project ce9392dff70048499a669777971b782c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:19.415362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.416192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.416494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3ec4b469a64e48b5b68a960967999e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.418394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1001/2006] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:19 2022] DELETE /identity/v3/projects/ce9392dff70048499a669777971b782c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:19.421995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:19.423325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:19.425918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1006/2007] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:19 2022] DELETE /identity/v3/users/af3ec4b469a64e48b5b68a960967999e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:19.428807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:19.428807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:19.498385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d63c10-9a70-42d9-b311-eef6a385fbde admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:19.519189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc896-005c-45d1-820b-63e4a4799cd7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:19.529609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:19.530268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:19.530575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:19.533793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] PATH_INFO: `/v3/users/d72bd48b4b0b45de98c75228bcb7013c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:19.536288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72bd48b4b0b45de98c75228bcb7013c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:19.538899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:19.571197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:19.617537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc2d8-819e-4016-ba9d-edbe0594b4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:19.618495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc2d8-819e-4016-ba9d-edbe0594b4cd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:19.618780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc2d8-819e-4016-ba9d-edbe0594b4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:19.619349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc2d8-819e-4016-ba9d-edbe0594b4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:19.620758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccc2d8-819e-4016-ba9d-edbe0594b4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:19.622983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccc2d8-819e-4016-ba9d-edbe0594b4cd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:19.627290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72bd48b4b0b45de98c75228bcb7013c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.656492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72bd48b4b0b45de98c75228bcb7013c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.662267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1002/2008] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:19 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:19.665518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc2d8-819e-4016-ba9d-edbe0594b4cd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:19.675016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72bd48b4b0b45de98c75228bcb7013c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.675665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72bd48b4b0b45de98c75228bcb7013c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.688648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72bd48b4b0b45de98c75228bcb7013c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:19.704340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1007/2009] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:19 2022] DELETE /identity/v3/users/d72bd48b4b0b45de98c75228bcb7013c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:19.735479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:19.754887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc2d8-819e-4016-ba9d-edbe0594b4cd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:19.860247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:19.861209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:19.861443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:19.861740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:19.862519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:19.867890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:19.907413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1003/2010] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:19 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:19.909856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:19.911573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:19.934373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d41041-ad09-4167-923f-963c006365ba admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:19.935815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:19.937725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:19.969973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5dd29-a4cb-41b9-84b8-643c32370c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:19.974477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5dd29-a4cb-41b9-84b8-643c32370c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:19.977073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5dd29-a4cb-41b9-84b8-643c32370c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:19.978540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5dd29-a4cb-41b9-84b8-643c32370c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:19.979731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5dd29-a4cb-41b9-84b8-643c32370c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:19.982355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ebd2-3966-479d-8563-42ace9eecb00 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:19.984324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5dd29-a4cb-41b9-84b8-643c32370c12 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.015954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.016849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.017319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.017825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] PATH_INFO: `/v3/projects/4e2b138c2ddb439a8f00f7c77919b85a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.020295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2b138c2ddb439a8f00f7c77919b85a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.022659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.028770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1008/2011] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:20.030549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5dd29-a4cb-41b9-84b8-643c32370c12 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.055254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5dd29-a4cb-41b9-84b8-643c32370c12 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.067248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a527-1519-4b1c-97b5-7e12ba5537c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.069143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a527-1519-4b1c-97b5-7e12ba5537c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.070055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a527-1519-4b1c-97b5-7e12ba5537c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.070815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a527-1519-4b1c-97b5-7e12ba5537c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.073182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a527-1519-4b1c-97b5-7e12ba5537c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.078356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a527-1519-4b1c-97b5-7e12ba5537c5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.104857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1009/2012] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:20.106078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a527-1519-4b1c-97b5-7e12ba5537c5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.139201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a527-1519-4b1c-97b5-7e12ba5537c5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.146482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2b138c2ddb439a8f00f7c77919b85a', 'request_id': 'req-c0580b61-2766-4620-b4e2-3bc269899833'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.164656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2b138c2ddb439a8f00f7c77919b85a', 'request_id': 'req-c0580b61-2766-4620-b4e2-3bc269899833'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.175620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2b138c2ddb439a8f00f7c77919b85a', 'request_id': 'req-c0580b61-2766-4620-b4e2-3bc269899833'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.193852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] The token cache is being invalidate because project 4e2b138c2ddb439a8f00f7c77919b85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:20.194082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.194971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0580b61-2766-4620-b4e2-3bc269899833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.198526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1004/2013] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:19 2022] DELETE /identity/v3/projects/4e2b138c2ddb439a8f00f7c77919b85a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:20.210814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370e9aa-2fde-4858-a346-5f2db1c08cde None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.211142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370e9aa-2fde-4858-a346-5f2db1c08cde None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.211363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370e9aa-2fde-4858-a346-5f2db1c08cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.250258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5370e9aa-2fde-4858-a346-5f2db1c08cde None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:20.257014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5370e9aa-2fde-4858-a346-5f2db1c08cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.270701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c47a91-8328-4320-bb1c-8a94da85eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.271577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47a91-8328-4320-bb1c-8a94da85eea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.271933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47a91-8328-4320-bb1c-8a94da85eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.272285 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c47a91-8328-4320-bb1c-8a94da85eea6 admin admin] PATH_INFO: `/v3/projects/6f0ef707de1e4aebb393cfb93dd691b2/users/846b465df67b4b55848089525f8d2052/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.299986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c47a91-8328-4320-bb1c-8a94da85eea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0ef707de1e4aebb393cfb93dd691b2, user_id=846b465df67b4b55848089525f8d2052, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.302901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c47a91-8328-4320-bb1c-8a94da85eea6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.321722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1010/2014] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:20 2022] PUT /identity/v3/projects/6f0ef707de1e4aebb393cfb93dd691b2/users/846b465df67b4b55848089525f8d2052/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:20.335959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44667e-106f-40c3-89bd-1bcbd921f40f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.336292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44667e-106f-40c3-89bd-1bcbd921f40f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.336519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44667e-106f-40c3-89bd-1bcbd921f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.343766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1005/2015] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:20.353010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682e13-d51c-4a4f-a509-cb3cd91ea3bb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.353855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682e13-d51c-4a4f-a509-cb3cd91ea3bb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.354132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682e13-d51c-4a4f-a509-cb3cd91ea3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.368612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:20.377246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6e682e13-d51c-4a4f-a509-cb3cd91ea3bb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:20.382011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e682e13-d51c-4a4f-a509-cb3cd91ea3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.383972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6e44667e-106f-40c3-89bd-1bcbd921f40f None None] MFA Rules not processed for user `846b465df67b4b55848089525f8d2052`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:20.385982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6e44667e-106f-40c3-89bd-1bcbd921f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.452808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:20.458843 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1006/2016] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:20.461587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e682e13-d51c-4a4f-a509-cb3cd91ea3bb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.461587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e682e13-d51c-4a4f-a509-cb3cd91ea3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.474806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e682e13-d51c-4a4f-a509-cb3cd91ea3bb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.481316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.482438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.482550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.482736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] PATH_INFO: `/v3/projects/c1f7060e1fda40ce9192c07d03eb3a73` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.484549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f7060e1fda40ce9192c07d03eb3a73)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.486518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.489031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1011/2017] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:20.497984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44667e-106f-40c3-89bd-1bcbd921f40f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.513855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44667e-106f-40c3-89bd-1bcbd921f40f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.523734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.524330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.524686 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.524965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.526627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:20.526627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.529139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.545457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1012/2018] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:20.545457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.547610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.557616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f7060e1fda40ce9192c07d03eb3a73', 'request_id': 'req-624ae03c-e44a-4f2f-b83a-75572e9c43a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.563569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c6cd4-82d3-4b12-a101-e337697a5e1c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.565566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f7060e1fda40ce9192c07d03eb3a73', 'request_id': 'req-624ae03c-e44a-4f2f-b83a-75572e9c43a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.578462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f7060e1fda40ce9192c07d03eb3a73', 'request_id': 'req-624ae03c-e44a-4f2f-b83a-75572e9c43a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.592821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] The token cache is being invalidate because project c1f7060e1fda40ce9192c07d03eb3a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:20.593202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.594260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:20.595795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1007/2019] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:20 2022] DELETE /identity/v3/projects/c1f7060e1fda40ce9192c07d03eb3a73 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:20.596921 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.598033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.637585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071eb5d-abd7-492b-b468-a108a536af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.638265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071eb5d-abd7-492b-b468-a108a536af4f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.638660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071eb5d-abd7-492b-b468-a108a536af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.638941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071eb5d-abd7-492b-b468-a108a536af4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.639635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071eb5d-abd7-492b-b468-a108a536af4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.641576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071eb5d-abd7-492b-b468-a108a536af4f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.678462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1013/2020] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:20.680061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8c3a4-c578-406d-8fa5-037157760abb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.680357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8c3a4-c578-406d-8fa5-037157760abb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.680631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8c3a4-c578-406d-8fa5-037157760abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.681847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ae03c-e44a-4f2f-b83a-75572e9c43a4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.709922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f5a8c3a4-c578-406d-8fa5-037157760abb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:20.711185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f5a8c3a4-c578-406d-8fa5-037157760abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.729591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:20.769974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.770663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.771162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.771449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.773069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.775985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.813774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1008/2021] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:20.814811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.817320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.832586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1014/2022] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:20.834943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8c3a4-c578-406d-8fa5-037157760abb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.847065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8c3a4-c578-406d-8fa5-037157760abb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.919293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a4db-430d-4223-b24d-895a3bdef7e7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.924316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f91441-128b-4b9a-8bfe-3222bd2e7771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.925040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91441-128b-4b9a-8bfe-3222bd2e7771 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.925191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91441-128b-4b9a-8bfe-3222bd2e7771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.925490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91441-128b-4b9a-8bfe-3222bd2e7771 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.925913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c821269-3de5-4a71-87c1-e2b11738996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.926166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f91441-128b-4b9a-8bfe-3222bd2e7771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.926704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821269-3de5-4a71-87c1-e2b11738996a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.927053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821269-3de5-4a71-87c1-e2b11738996a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.927397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821269-3de5-4a71-87c1-e2b11738996a admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.928051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f91441-128b-4b9a-8bfe-3222bd2e7771 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.928144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c821269-3de5-4a71-87c1-e2b11738996a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.930697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c821269-3de5-4a71-87c1-e2b11738996a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.942579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:20.955873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1009/2023] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:20.957676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681098-12b8-4f46-a335-7df4c506d1ad None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.958307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1015/2024] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:20.958662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681098-12b8-4f46-a335-7df4c506d1ad None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.959143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a681098-12b8-4f46-a335-7df4c506d1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.959346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c821269-3de5-4a71-87c1-e2b11738996a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.971823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c821269-3de5-4a71-87c1-e2b11738996a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:20.977722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef04f8-c055-4996-b824-240e3efe29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:20.978534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef04f8-c055-4996-b824-240e3efe29e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:20.978965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef04f8-c055-4996-b824-240e3efe29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:20.979252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef04f8-c055-4996-b824-240e3efe29e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:20.979951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef04f8-c055-4996-b824-240e3efe29e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:20.981818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef04f8-c055-4996-b824-240e3efe29e1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:20.984859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4a681098-12b8-4f46-a335-7df4c506d1ad None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:20.986342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4a681098-12b8-4f46-a335-7df4c506d1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:20.995361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1010/2025] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:20.999012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681098-12b8-4f46-a335-7df4c506d1ad None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:20.999181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1016/2026] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:20.999949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef04f8-c055-4996-b824-240e3efe29e1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.007525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a681098-12b8-4f46-a335-7df4c506d1ad None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.012537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef04f8-c055-4996-b824-240e3efe29e1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.013656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74025d-f3e8-4a8e-bc89-494653566d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.014362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74025d-f3e8-4a8e-bc89-494653566d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.014708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74025d-f3e8-4a8e-bc89-494653566d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.015047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74025d-f3e8-4a8e-bc89-494653566d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.015773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74025d-f3e8-4a8e-bc89-494653566d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.017787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74025d-f3e8-4a8e-bc89-494653566d0d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.019025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.019790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.020180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.020449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.021349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:21.022244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.023346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.030323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1011/2027] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:21.031207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74025d-f3e8-4a8e-bc89-494653566d0d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.041575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1017/2028] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:21.041575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.043134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74025d-f3e8-4a8e-bc89-494653566d0d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.049622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7083d50-3627-491c-84a5-4200150c37ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.050316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083d50-3627-491c-84a5-4200150c37ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.050601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083d50-3627-491c-84a5-4200150c37ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.050879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7083d50-3627-491c-84a5-4200150c37ec admin admin] PATH_INFO: `/v3/projects/2521abeba35b47a29481e72fd8d83c44/users/a743534c234746359e75ab8a45401ec5/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.055642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acb211-b4b2-4f4e-8e7a-eda7cb1a7e9e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.060381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543238e2-956b-4675-bd6c-8831ed940486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.060980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543238e2-956b-4675-bd6c-8831ed940486 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.061259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543238e2-956b-4675-bd6c-8831ed940486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.061562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543238e2-956b-4675-bd6c-8831ed940486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.062200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543238e2-956b-4675-bd6c-8831ed940486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.063787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543238e2-956b-4675-bd6c-8831ed940486 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.068526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7083d50-3627-491c-84a5-4200150c37ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2521abeba35b47a29481e72fd8d83c44, user_id=a743534c234746359e75ab8a45401ec5, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.071404 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7083d50-3627-491c-84a5-4200150c37ec admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.075069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1018/2029] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:21.076106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543238e2-956b-4675-bd6c-8831ed940486 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.088530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543238e2-956b-4675-bd6c-8831ed940486 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.091439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1012/2030] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:21 2022] PUT /identity/v3/projects/2521abeba35b47a29481e72fd8d83c44/users/a743534c234746359e75ab8a45401ec5/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:21.094378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7083d50-3627-491c-84a5-4200150c37ec admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.157767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b2d38-128c-44fa-8c06-36617dafb288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.158425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2d38-128c-44fa-8c06-36617dafb288 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.158711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2d38-128c-44fa-8c06-36617dafb288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.158987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2d38-128c-44fa-8c06-36617dafb288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.159761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b2d38-128c-44fa-8c06-36617dafb288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.161846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b2d38-128c-44fa-8c06-36617dafb288 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.184647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7083d50-3627-491c-84a5-4200150c37ec admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.189375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1019/2031] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:21 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:21.189591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1feda-8e0a-407e-82be-cb216902b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.190164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b2d38-128c-44fa-8c06-36617dafb288 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.190265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1feda-8e0a-407e-82be-cb216902b0ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.190642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1feda-8e0a-407e-82be-cb216902b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.190919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1feda-8e0a-407e-82be-cb216902b0ea admin admin] PATH_INFO: `/v3/projects/5a42280dc7d14035bbe9e10e01483954/users/9b9c627daafe4de7af2cea7d017c5260/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.207065 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1feda-8e0a-407e-82be-cb216902b0ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a42280dc7d14035bbe9e10e01483954, user_id=9b9c627daafe4de7af2cea7d017c5260, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.209890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1feda-8e0a-407e-82be-cb216902b0ea admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.212270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:21.226779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1013/2032] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:21 2022] PUT /identity/v3/projects/5a42280dc7d14035bbe9e10e01483954/users/9b9c627daafe4de7af2cea7d017c5260/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:21.227383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1feda-8e0a-407e-82be-cb216902b0ea admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.270449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b2d38-128c-44fa-8c06-36617dafb288 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.297389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1feda-8e0a-407e-82be-cb216902b0ea admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.302210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4b7f7-e8d2-4352-87ee-14746ef52d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.302856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b7f7-e8d2-4352-87ee-14746ef52d78 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.303132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b7f7-e8d2-4352-87ee-14746ef52d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.303403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b7f7-e8d2-4352-87ee-14746ef52d78 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.304037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4b7f7-e8d2-4352-87ee-14746ef52d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.306030 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4b7f7-e8d2-4352-87ee-14746ef52d78 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.334616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:21.340291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1014/2033] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:21 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:21.342216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf63ce-cdc1-47b8-8911-ca06ba0dee58 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.342516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf63ce-cdc1-47b8-8911-ca06ba0dee58 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.343091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf63ce-cdc1-47b8-8911-ca06ba0dee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.357774 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb210f88-89b8-4d3e-a51e-33427e9d9564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.358945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb210f88-89b8-4d3e-a51e-33427e9d9564 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.359325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb210f88-89b8-4d3e-a51e-33427e9d9564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.360252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb210f88-89b8-4d3e-a51e-33427e9d9564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.360982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb210f88-89b8-4d3e-a51e-33427e9d9564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.364141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb210f88-89b8-4d3e-a51e-33427e9d9564 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.381233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bfcf63ce-cdc1-47b8-8911-ca06ba0dee58 None None] MFA Rules not processed for user `9b9c627daafe4de7af2cea7d017c5260`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:21.382627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bfcf63ce-cdc1-47b8-8911-ca06ba0dee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:21.391369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1020/2034] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:21.392290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb210f88-89b8-4d3e-a51e-33427e9d9564 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.404586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb210f88-89b8-4d3e-a51e-33427e9d9564 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.409878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff3ea3-9e10-44c3-9b3c-b1dca67e10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.410396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff3ea3-9e10-44c3-9b3c-b1dca67e10f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.410680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff3ea3-9e10-44c3-9b3c-b1dca67e10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.410956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff3ea3-9e10-44c3-9b3c-b1dca67e10f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.411743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff3ea3-9e10-44c3-9b3c-b1dca67e10f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.417474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff3ea3-9e10-44c3-9b3c-b1dca67e10f6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.427435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1021/2035] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:21.427435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff3ea3-9e10-44c3-9b3c-b1dca67e10f6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.439668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff3ea3-9e10-44c3-9b3c-b1dca67e10f6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.446319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1c90-25fc-4803-8ced-b31e8e1648ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.447066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1c90-25fc-4803-8ced-b31e8e1648ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.447350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1c90-25fc-4803-8ced-b31e8e1648ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.447622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1c90-25fc-4803-8ced-b31e8e1648ad admin admin] PATH_INFO: `/v3/projects/2521abeba35b47a29481e72fd8d83c44/users/a743534c234746359e75ab8a45401ec5/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.450002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1c90-25fc-4803-8ced-b31e8e1648ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2521abeba35b47a29481e72fd8d83c44, user_id=a743534c234746359e75ab8a45401ec5, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.453090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1c90-25fc-4803-8ced-b31e8e1648ad admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.469120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1022/2036] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:21 2022] PUT /identity/v3/projects/2521abeba35b47a29481e72fd8d83c44/users/a743534c234746359e75ab8a45401ec5/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:21.474667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1c90-25fc-4803-8ced-b31e8e1648ad admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.517968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1015/2037] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:21.519635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb27ae-a7df-4eab-aec9-f2f9389ffbc3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.520136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb27ae-a7df-4eab-aec9-f2f9389ffbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.520831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb27ae-a7df-4eab-aec9-f2f9389ffbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.562722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fbbb27ae-a7df-4eab-aec9-f2f9389ffbc3 None None] MFA Rules not processed for user `a743534c234746359e75ab8a45401ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:21.564722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fbbb27ae-a7df-4eab-aec9-f2f9389ffbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:21.576428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1c90-25fc-4803-8ced-b31e8e1648ad admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.581582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.582552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.582552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.582834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.583483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.585420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.598217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1023/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:21.599011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.600837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:21.647381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:21.669469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1016/2039] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:21.671538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb27ae-a7df-4eab-aec9-f2f9389ffbc3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.683387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52448c-7a5b-4171-bcf4-920240dfcbc4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.684771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb27ae-a7df-4eab-aec9-f2f9389ffbc3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.696518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58411e33-dcfd-4129-9668-2e98144eca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.696719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf65c0-e63a-4728-8187-594bddd05a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.697933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf65c0-e63a-4728-8187-594bddd05a8d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.698527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf65c0-e63a-4728-8187-594bddd05a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.698633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411e33-dcfd-4129-9668-2e98144eca29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.698858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411e33-dcfd-4129-9668-2e98144eca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.699040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf65c0-e63a-4728-8187-594bddd05a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.699132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411e33-dcfd-4129-9668-2e98144eca29 admin admin] PATH_INFO: `/v3/projects/feca3fad66854c72a52bb6e4eecb7f9d/users/9655dc19c19c4d459c73686060c84b76/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.726100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58411e33-dcfd-4129-9668-2e98144eca29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feca3fad66854c72a52bb6e4eecb7f9d, user_id=9655dc19c19c4d459c73686060c84b76, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.738849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58411e33-dcfd-4129-9668-2e98144eca29 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.756621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1017/2040] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:21 2022] PUT /identity/v3/projects/feca3fad66854c72a52bb6e4eecb7f9d/users/9655dc19c19c4d459c73686060c84b76/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:21.770175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48b2a1-885b-4af5-a066-3449087ade5b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.770460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48b2a1-885b-4af5-a066-3449087ade5b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.770738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48b2a1-885b-4af5-a066-3449087ade5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.794950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf65c0-e63a-4728-8187-594bddd05a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.799079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf65c0-e63a-4728-8187-594bddd05a8d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:21.810518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5f48b2a1-885b-4af5-a066-3449087ade5b None None] MFA Rules not processed for user `9655dc19c19c4d459c73686060c84b76`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:21.812062 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5f48b2a1-885b-4af5-a066-3449087ade5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:21.812173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1024/2041] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:21.886295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf65c0-e63a-4728-8187-594bddd05a8d service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.893676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1018/2042] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:21.895004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf65c0-e63a-4728-8187-594bddd05a8d service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.898564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48b2a1-885b-4af5-a066-3449087ade5b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:21.906836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:21.957225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.957870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.958157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.958428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.960247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:21.984311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48b2a1-885b-4af5-a066-3449087ade5b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:21.989294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa0b2-09ab-46ed-9d4e-47bb61462456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:21.990077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa0b2-09ab-46ed-9d4e-47bb61462456 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:21.990461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa0b2-09ab-46ed-9d4e-47bb61462456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:21.990859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa0b2-09ab-46ed-9d4e-47bb61462456 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:21.992100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaa0b2-09ab-46ed-9d4e-47bb61462456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:21.993749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaa0b2-09ab-46ed-9d4e-47bb61462456 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.026148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1019/2043] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:21 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:22.030144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa0b2-09ab-46ed-9d4e-47bb61462456 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.036256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.037700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.050496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1025/2044] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:22.092143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:22.112473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa0b2-09ab-46ed-9d4e-47bb61462456 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.118004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d917-75c2-4e47-8b07-7f1150011aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:22.119120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d917-75c2-4e47-8b07-7f1150011aea admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.119240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d917-75c2-4e47-8b07-7f1150011aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.119675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d917-75c2-4e47-8b07-7f1150011aea admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.120464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39d917-75c2-4e47-8b07-7f1150011aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.129802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39d917-75c2-4e47-8b07-7f1150011aea admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.170727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1020/2045] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:22 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:22.170817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.186156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09edfa-ce19-40b9-9b62-ea376826a775 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.191434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a11d2-52c6-475e-aef5-b1fdb6016602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:22.192046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a11d2-52c6-475e-aef5-b1fdb6016602 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.192334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a11d2-52c6-475e-aef5-b1fdb6016602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.192606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a11d2-52c6-475e-aef5-b1fdb6016602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.193339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a11d2-52c6-475e-aef5-b1fdb6016602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.195239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a11d2-52c6-475e-aef5-b1fdb6016602 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.207983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1026/2046] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:22.211911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d917-75c2-4e47-8b07-7f1150011aea admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.225968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d917-75c2-4e47-8b07-7f1150011aea admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.239263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecba091-b5b9-43e1-aadb-2a395dd91f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:22.239917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba091-b5b9-43e1-aadb-2a395dd91f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.240193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba091-b5b9-43e1-aadb-2a395dd91f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.240539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba091-b5b9-43e1-aadb-2a395dd91f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.241234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecba091-b5b9-43e1-aadb-2a395dd91f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.243053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecba091-b5b9-43e1-aadb-2a395dd91f20 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.264721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1021/2047] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:22.266458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a11d2-52c6-475e-aef5-b1fdb6016602 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.279904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a11d2-52c6-475e-aef5-b1fdb6016602 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.286019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1130c-9faf-4da6-9078-751d2023f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:22.286967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1130c-9faf-4da6-9078-751d2023f1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.288800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1130c-9faf-4da6-9078-751d2023f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.289186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1130c-9faf-4da6-9078-751d2023f1aa admin admin] PATH_INFO: `/v3/projects/712625229c6842d884b7d6e39214c0a7/users/0d5fd2ee6d2243c9bb39c05ee8729760/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.307662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1130c-9faf-4da6-9078-751d2023f1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=712625229c6842d884b7d6e39214c0a7, user_id=0d5fd2ee6d2243c9bb39c05ee8729760, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.310843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1130c-9faf-4da6-9078-751d2023f1aa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.332591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1027/2048] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:22 2022] PUT /identity/v3/projects/712625229c6842d884b7d6e39214c0a7/users/0d5fd2ee6d2243c9bb39c05ee8729760/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:22.343166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0caa2-8184-445b-aa4f-932347f3b490 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.343595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0caa2-8184-445b-aa4f-932347f3b490 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.343984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0caa2-8184-445b-aa4f-932347f3b490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.376929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b0d0caa2-8184-445b-aa4f-932347f3b490 None None] MFA Rules not processed for user `0d5fd2ee6d2243c9bb39c05ee8729760`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:22.378374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b0d0caa2-8184-445b-aa4f-932347f3b490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:22.487174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1022/2049] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:22.492163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1130c-9faf-4da6-9078-751d2023f1aa admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.633031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1130c-9faf-4da6-9078-751d2023f1aa admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.657968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fda5c3-38b5-465a-8d24-a7d186cf9aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:22.659210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda5c3-38b5-465a-8d24-a7d186cf9aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.659591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda5c3-38b5-465a-8d24-a7d186cf9aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.660019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda5c3-38b5-465a-8d24-a7d186cf9aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.661331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fda5c3-38b5-465a-8d24-a7d186cf9aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.666556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fda5c3-38b5-465a-8d24-a7d186cf9aeb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.715559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1028/2050] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:22 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:22.719518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0caa2-8184-445b-aa4f-932347f3b490 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.732499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0caa2-8184-445b-aa4f-932347f3b490 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.799020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fca12-0d83-4756-a6c4-7e9bca0ee69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:22.799763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fca12-0d83-4756-a6c4-7e9bca0ee69a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.800113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fca12-0d83-4756-a6c4-7e9bca0ee69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.800453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fca12-0d83-4756-a6c4-7e9bca0ee69a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.801182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fca12-0d83-4756-a6c4-7e9bca0ee69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.803289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fca12-0d83-4756-a6c4-7e9bca0ee69a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.831102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1023/2051] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:22 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:22.835257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fda5c3-38b5-465a-8d24-a7d186cf9aeb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.846564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fda5c3-38b5-465a-8d24-a7d186cf9aeb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.857614 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ac7e-495c-4f3b-b4f0-b61e883d5e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:22.858243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ac7e-495c-4f3b-b4f0-b61e883d5e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.858631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ac7e-495c-4f3b-b4f0-b61e883d5e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.860221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ac7e-495c-4f3b-b4f0-b61e883d5e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.861095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2ac7e-495c-4f3b-b4f0-b61e883d5e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.862532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2ac7e-495c-4f3b-b4f0-b61e883d5e1b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.875534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1029/2052] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:22.879367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fca12-0d83-4756-a6c4-7e9bca0ee69a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.896715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fca12-0d83-4756-a6c4-7e9bca0ee69a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.905359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b87d40-5275-4a26-ba34-d689aeae5756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:22.906293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87d40-5275-4a26-ba34-d689aeae5756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:22.906577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87d40-5275-4a26-ba34-d689aeae5756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:22.906855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b87d40-5275-4a26-ba34-d689aeae5756 admin admin] PATH_INFO: `/v3/projects/142fe2ee4e1c45f5b29078f37a29d1a9/users/63737ca52f6847c6ac835d5f76a96c56/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:22.925093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b87d40-5275-4a26-ba34-d689aeae5756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142fe2ee4e1c45f5b29078f37a29d1a9, user_id=63737ca52f6847c6ac835d5f76a96c56, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:22.931659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b87d40-5275-4a26-ba34-d689aeae5756 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:22.949739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1024/2053] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:22 2022] PUT /identity/v3/projects/142fe2ee4e1c45f5b29078f37a29d1a9/users/63737ca52f6847c6ac835d5f76a96c56/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:22.951893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ac7e-495c-4f3b-b4f0-b61e883d5e1b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:22.963477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ac7e-495c-4f3b-b4f0-b61e883d5e1b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:22.967392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:23.024635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162743ed-6f88-4d95-8301-3cdfbe3ae776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:23.026063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162743ed-6f88-4d95-8301-3cdfbe3ae776 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:23.026063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162743ed-6f88-4d95-8301-3cdfbe3ae776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:23.026349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162743ed-6f88-4d95-8301-3cdfbe3ae776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:23.026976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162743ed-6f88-4d95-8301-3cdfbe3ae776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:23.028576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162743ed-6f88-4d95-8301-3cdfbe3ae776 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:23.038530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1030/2054] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:23.043480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b87d40-5275-4a26-ba34-d689aeae5756 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:23.054682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b87d40-5275-4a26-ba34-d689aeae5756 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:23.059801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:23.060485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:23.060768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:23.061046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] PATH_INFO: `/v3/projects/142fe2ee4e1c45f5b29078f37a29d1a9/users/63737ca52f6847c6ac835d5f76a96c56/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:23.063058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142fe2ee4e1c45f5b29078f37a29d1a9, user_id=63737ca52f6847c6ac835d5f76a96c56, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:23.065934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:23.078336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1025/2055] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:23 2022] PUT /identity/v3/projects/142fe2ee4e1c45f5b29078f37a29d1a9/users/63737ca52f6847c6ac835d5f76a96c56/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:23.090558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774194-15fa-45ed-a82e-cdd7c9b278f7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:23.090853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774194-15fa-45ed-a82e-cdd7c9b278f7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:23.091134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774194-15fa-45ed-a82e-cdd7c9b278f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:23.131197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2f774194-15fa-45ed-a82e-cdd7c9b278f7 None None] MFA Rules not processed for user `63737ca52f6847c6ac835d5f76a96c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:23.132493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2f774194-15fa-45ed-a82e-cdd7c9b278f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:23.201186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1031/2056] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:23.212761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:23.214646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:23.226132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:23.284258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323f980-387e-44a4-8800-0080c614eb01 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:23.291586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7aebc-2056-407b-ab22-c8a4b536a208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:23.292884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7aebc-2056-407b-ab22-c8a4b536a208 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:23.293344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7aebc-2056-407b-ab22-c8a4b536a208 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:23.293840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7aebc-2056-407b-ab22-c8a4b536a208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:23.367720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7aebc-2056-407b-ab22-c8a4b536a208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:23.369732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7aebc-2056-407b-ab22-c8a4b536a208 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:23.385208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1026/2057] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:24.144644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f774194-15fa-45ed-a82e-cdd7c9b278f7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:24.154828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f774194-15fa-45ed-a82e-cdd7c9b278f7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:24.159007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:24.159629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:24.159929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:24.160210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:24.162095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:24.252249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:24.253741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:24.264091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1032/2058] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:25.310298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7aebc-2056-407b-ab22-c8a4b536a208 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:25.314827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:25.319535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7aebc-2056-407b-ab22-c8a4b536a208 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:25.323709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a423-7aa4-4fa3-9ecc-ad31a9315326 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:25.324040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf794-e1f8-47e3-b953-95b453afc17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:25.324653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf794-e1f8-47e3-b953-95b453afc17a service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:25.324957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf794-e1f8-47e3-b953-95b453afc17a service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:25.325236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abf794-e1f8-47e3-b953-95b453afc17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:25.327779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:25.328509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:25.328854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:25.329198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:25.359147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:25.400648 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abf794-e1f8-47e3-b953-95b453afc17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:25.402217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abf794-e1f8-47e3-b953-95b453afc17a service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:25.403881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:25.405359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:25.412247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1027/2059] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:25.414891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1033/2060] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:26.301763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf794-e1f8-47e3-b953-95b453afc17a service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:26.309394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abf794-e1f8-47e3-b953-95b453afc17a service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:26.313688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6c486-5a65-482f-a0cd-a1c36d360fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:26.314401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6c486-5a65-482f-a0cd-a1c36d360fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:26.314758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6c486-5a65-482f-a0cd-a1c36d360fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:26.315040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6c486-5a65-482f-a0cd-a1c36d360fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:26.325490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6c486-5a65-482f-a0cd-a1c36d360fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:26.327003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6c486-5a65-482f-a0cd-a1c36d360fd4 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:26.346946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1028/2061] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:26.420383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:26.421888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:26.546198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316263-42e5-44fe-9690-6614efe80dfc service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:26.551601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:26.552485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:26.553145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:26.553721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] PATH_INFO: `/v3/users/98f61652fb5b4b87a1cad5c6fcf0cf9e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:26.555121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f61652fb5b4b87a1cad5c6fcf0cf9e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:26.558583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:26.667218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f61652fb5b4b87a1cad5c6fcf0cf9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:26.693969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f61652fb5b4b87a1cad5c6fcf0cf9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:26.707925 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f61652fb5b4b87a1cad5c6fcf0cf9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:26.708703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f61652fb5b4b87a1cad5c6fcf0cf9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:26.733074 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f61652fb5b4b87a1cad5c6fcf0cf9e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:26.741380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1034/2062] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:26 2022] DELETE /identity/v3/users/98f61652fb5b4b87a1cad5c6fcf0cf9e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:26.746230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab773c-9f05-47f1-baee-b88c9639fea4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:26.746519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab773c-9f05-47f1-baee-b88c9639fea4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:26.746799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab773c-9f05-47f1-baee-b88c9639fea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:26.772035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7eab773c-9f05-47f1-baee-b88c9639fea4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:26.776540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7eab773c-9f05-47f1-baee-b88c9639fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:26.846452 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:26.874701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1029/2063] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:26.891202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:26.892759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:26.964055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:27.007538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa7170-2136-4111-bbe3-16cc75cc512f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:27.015148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024d20-394b-41d0-8ca7-31aec2bc696d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:27.016125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024d20-394b-41d0-8ca7-31aec2bc696d service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:27.017538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024d20-394b-41d0-8ca7-31aec2bc696d service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:27.018022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024d20-394b-41d0-8ca7-31aec2bc696d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:27.039001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08024d20-394b-41d0-8ca7-31aec2bc696d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:27.042752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08024d20-394b-41d0-8ca7-31aec2bc696d service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:27.053934 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1035/2064] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:27.655525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab773c-9f05-47f1-baee-b88c9639fea4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:27.657094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7eab773c-9f05-47f1-baee-b88c9639fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:27.677129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab773c-9f05-47f1-baee-b88c9639fea4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:27.684120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:27.685044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:27.685352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:27.685674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] PATH_INFO: `/v3/projects/edee97a2f04a4e3c892b6b3f257eedfd` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:27.687060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edee97a2f04a4e3c892b6b3f257eedfd)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:27.689903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:27.747129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edee97a2f04a4e3c892b6b3f257eedfd', 'request_id': 'req-39bdf2a2-bbd0-4793-adc6-f49df2639079'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:27.753720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edee97a2f04a4e3c892b6b3f257eedfd', 'request_id': 'req-39bdf2a2-bbd0-4793-adc6-f49df2639079'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:27.761834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edee97a2f04a4e3c892b6b3f257eedfd', 'request_id': 'req-39bdf2a2-bbd0-4793-adc6-f49df2639079'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:27.778089 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] The token cache is being invalidate because project edee97a2f04a4e3c892b6b3f257eedfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:27.778674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:27.779841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:27.782335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1030/2065] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:27 2022] DELETE /identity/v3/projects/edee97a2f04a4e3c892b6b3f257eedfd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:27.786432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024d20-394b-41d0-8ca7-31aec2bc696d service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:27.799261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024d20-394b-41d0-8ca7-31aec2bc696d service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:27.891216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:27.892122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:27.892847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:27.893653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] PATH_INFO: `/v3/users/3c4b37da792b4a9aaf7a66ad0d617a1b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:27.895577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4b37da792b4a9aaf7a66ad0d617a1b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:27.898931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:28.035386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4b37da792b4a9aaf7a66ad0d617a1b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.050987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4b37da792b4a9aaf7a66ad0d617a1b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.084034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4b37da792b4a9aaf7a66ad0d617a1b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.084621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4b37da792b4a9aaf7a66ad0d617a1b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.093124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d4fab54-512f-4f41-90a6-9e50cd1cd047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4b37da792b4a9aaf7a66ad0d617a1b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.107534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1036/2066] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:27 2022] DELETE /identity/v3/users/3c4b37da792b4a9aaf7a66ad0d617a1b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:28.619396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:28.621383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:28.637803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdf2a2-bbd0-4793-adc6-f49df2639079 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:28.706294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:28.707086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:28.707186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:28.707451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] PATH_INFO: `/v3/projects/2043abb36c9e4861824d2b961a27661a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:28.708567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2043abb36c9e4861824d2b961a27661a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:28.710531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:28.760903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2043abb36c9e4861824d2b961a27661a', 'request_id': 'req-d919074d-624f-433b-8c3a-d36fbcd502b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.766411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2043abb36c9e4861824d2b961a27661a', 'request_id': 'req-d919074d-624f-433b-8c3a-d36fbcd502b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.772619 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2043abb36c9e4861824d2b961a27661a', 'request_id': 'req-d919074d-624f-433b-8c3a-d36fbcd502b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.781903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:28.787809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] The token cache is being invalidate because project 2043abb36c9e4861824d2b961a27661a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:28.788141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.789579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d919074d-624f-433b-8c3a-d36fbcd502b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:28.791814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1031/2067] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:28 2022] DELETE /identity/v3/projects/2043abb36c9e4861824d2b961a27661a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:28.797072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79ef2-8ede-498c-a472-b2ae21b469bc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:28.797605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79ef2-8ede-498c-a472-b2ae21b469bc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:28.797682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79ef2-8ede-498c-a472-b2ae21b469bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:28.819191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e1d79ef2-8ede-498c-a472-b2ae21b469bc None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:28.820696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e1d79ef2-8ede-498c-a472-b2ae21b469bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:28.893075 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1037/2068] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:28.901506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9fbfb-9727-4df5-92d2-4022c8f47f47 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:28.901799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9fbfb-9727-4df5-92d2-4022c8f47f47 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:28.902079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9fbfb-9727-4df5-92d2-4022c8f47f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:28.928224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9ad9fbfb-9727-4df5-92d2-4022c8f47f47 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:28.929730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9ad9fbfb-9727-4df5-92d2-4022c8f47f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:28.965165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1032/2069] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:28.970540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79ef2-8ede-498c-a472-b2ae21b469bc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:28.983859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79ef2-8ede-498c-a472-b2ae21b469bc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:28.992270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:28.993395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:28.993395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:28.994082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:28.995023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:28.995343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:28.998546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.000829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:29.020217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1038/2070] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:29.025578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9fbfb-9727-4df5-92d2-4022c8f47f47 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.039502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9fbfb-9727-4df5-92d2-4022c8f47f47 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.044728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4cfe1-2449-4867-9530-354b10ee45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:29.046053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4cfe1-2449-4867-9530-354b10ee45fa admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.046339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4cfe1-2449-4867-9530-354b10ee45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.046612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4cfe1-2449-4867-9530-354b10ee45fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.047415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4cfe1-2449-4867-9530-354b10ee45fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:29.049496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4cfe1-2449-4867-9530-354b10ee45fa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.100831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1033/2071] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:29 2022] POST /identity/v3/projects => generated 357 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:29.116450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.133369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f522278-4e7f-4530-9798-796c750a761b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.226151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ce3bb-6d40-46db-877e-5273d2652273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:29.226779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce3bb-6d40-46db-877e-5273d2652273 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.227184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce3bb-6d40-46db-877e-5273d2652273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.227471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce3bb-6d40-46db-877e-5273d2652273 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.228922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ce3bb-6d40-46db-877e-5273d2652273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:29.231889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ce3bb-6d40-46db-877e-5273d2652273 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.272959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1039/2072] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:29 2022] POST /identity/v3/users => generated 279 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:29.277923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4cfe1-2449-4867-9530-354b10ee45fa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.301710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4cfe1-2449-4867-9530-354b10ee45fa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.313694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8ba2d-c75b-4f2a-bb07-1220506af218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:29.314761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ba2d-c75b-4f2a-bb07-1220506af218 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.315317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ba2d-c75b-4f2a-bb07-1220506af218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.315739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8ba2d-c75b-4f2a-bb07-1220506af218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.316537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8ba2d-c75b-4f2a-bb07-1220506af218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:29.318513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8ba2d-c75b-4f2a-bb07-1220506af218 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.332055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1034/2073] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:29.336034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ce3bb-6d40-46db-877e-5273d2652273 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.351787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ce3bb-6d40-46db-877e-5273d2652273 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.357428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4225e03-863d-44ff-afdb-3fed0e33528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:29.358073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225e03-863d-44ff-afdb-3fed0e33528a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.358351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225e03-863d-44ff-afdb-3fed0e33528a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.358623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225e03-863d-44ff-afdb-3fed0e33528a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.359795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4225e03-863d-44ff-afdb-3fed0e33528a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:29.361396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4225e03-863d-44ff-afdb-3fed0e33528a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.376120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1040/2074] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:29.380491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8ba2d-c75b-4f2a-bb07-1220506af218 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.398986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8ba2d-c75b-4f2a-bb07-1220506af218 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.404701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c657685-2a6b-47a4-b7ea-f07b081cce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:29.405427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c657685-2a6b-47a4-b7ea-f07b081cce3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.405789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c657685-2a6b-47a4-b7ea-f07b081cce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.406058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c657685-2a6b-47a4-b7ea-f07b081cce3b admin admin] PATH_INFO: `/v3/projects/9d6df00a262b41ee86a84650f0f12c4c/users/aa67fe0e31774829b370aede0e9786b7/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.430228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c657685-2a6b-47a4-b7ea-f07b081cce3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6df00a262b41ee86a84650f0f12c4c, user_id=aa67fe0e31774829b370aede0e9786b7, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:29.433395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c657685-2a6b-47a4-b7ea-f07b081cce3b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.450737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1035/2075] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:29 2022] PUT /identity/v3/projects/9d6df00a262b41ee86a84650f0f12c4c/users/aa67fe0e31774829b370aede0e9786b7/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:29.463072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727ab1-b3d1-490a-8744-a44669e9fca7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.463489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727ab1-b3d1-490a-8744-a44669e9fca7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.463766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727ab1-b3d1-490a-8744-a44669e9fca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.509611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-69727ab1-b3d1-490a-8744-a44669e9fca7 None None] MFA Rules not processed for user `aa67fe0e31774829b370aede0e9786b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:29.510846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-69727ab1-b3d1-490a-8744-a44669e9fca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:29.617667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c657685-2a6b-47a4-b7ea-f07b081cce3b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.619926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1041/2076] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:29.718990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c657685-2a6b-47a4-b7ea-f07b081cce3b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.726580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69727ab1-b3d1-490a-8744-a44669e9fca7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.735221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-69727ab1-b3d1-490a-8744-a44669e9fca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:29.738113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e161ce-12f6-4c05-b55b-2d348f683774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:29.738808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e161ce-12f6-4c05-b55b-2d348f683774 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.739007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e161ce-12f6-4c05-b55b-2d348f683774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.739355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e161ce-12f6-4c05-b55b-2d348f683774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.739901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e161ce-12f6-4c05-b55b-2d348f683774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:29.741949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e161ce-12f6-4c05-b55b-2d348f683774 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.760601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69727ab1-b3d1-490a-8744-a44669e9fca7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.788139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:29.789191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1036/2077] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:29 2022] POST /identity/v3/projects => generated 355 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:29.792493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.792493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.792493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] PATH_INFO: `/v3/users/b2432880be5e4837be5ed32809e8996f` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.792493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2432880be5e4837be5ed32809e8996f)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:29.794004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e161ce-12f6-4c05-b55b-2d348f683774 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.794215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.863684 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2432880be5e4837be5ed32809e8996f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:29.867075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e161ce-12f6-4c05-b55b-2d348f683774 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.872094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:29.873192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:29.874284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.874770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.875207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.876165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:29.878386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2432880be5e4837be5ed32809e8996f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:29.879463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:29.888235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2432880be5e4837be5ed32809e8996f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:29.889499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2432880be5e4837be5ed32809e8996f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:29.900272 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8c442c28-0a1f-4203-8512-a92487809ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2432880be5e4837be5ed32809e8996f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:29.911876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1037/2078] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:29 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:29.912042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1042/2079] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:29 2022] DELETE /identity/v3/users/b2432880be5e4837be5ed32809e8996f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:29.912126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:29.912639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:29.913854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693751c-fc91-46ba-81df-e676042e8e3b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:29.914225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693751c-fc91-46ba-81df-e676042e8e3b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:29.914620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693751c-fc91-46ba-81df-e676042e8e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:29.928202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4fd83-b429-48be-a900-c0ce0e75de8c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:29.935104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:29.942138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5693751c-fc91-46ba-81df-e676042e8e3b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:29.943395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5693751c-fc91-46ba-81df-e676042e8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:30.003524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815572d4-ef49-4646-9708-aa01d69c0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.004534 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815572d4-ef49-4646-9708-aa01d69c0685 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.004787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815572d4-ef49-4646-9708-aa01d69c0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.005148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815572d4-ef49-4646-9708-aa01d69c0685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.006064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815572d4-ef49-4646-9708-aa01d69c0685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.007426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815572d4-ef49-4646-9708-aa01d69c0685 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.022715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1038/2080] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:30.027125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815572d4-ef49-4646-9708-aa01d69c0685 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.041314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815572d4-ef49-4646-9708-aa01d69c0685 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.048170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1043/2081] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:30.050022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba60417-5b20-41f5-b742-fb30f824f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.051270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba60417-5b20-41f5-b742-fb30f824f79a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.051829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba60417-5b20-41f5-b742-fb30f824f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.052665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba60417-5b20-41f5-b742-fb30f824f79a admin admin] PATH_INFO: `/v3/projects/a030051075d44a58b68bc1ecae1fc0e2/users/d923b23500604bbdb1c8d2fe6a7d8812/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.060939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693751c-fc91-46ba-81df-e676042e8e3b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.062344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5693751c-fc91-46ba-81df-e676042e8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:30.079004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba60417-5b20-41f5-b742-fb30f824f79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a030051075d44a58b68bc1ecae1fc0e2, user_id=d923b23500604bbdb1c8d2fe6a7d8812, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.086317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba60417-5b20-41f5-b742-fb30f824f79a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.102486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1039/2082] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:30 2022] PUT /identity/v3/projects/a030051075d44a58b68bc1ecae1fc0e2/users/d923b23500604bbdb1c8d2fe6a7d8812/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:30.108236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba60417-5b20-41f5-b742-fb30f824f79a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.135590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693751c-fc91-46ba-81df-e676042e8e3b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.197198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799b739-1beb-43f6-be59-3156e9023fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.197871 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b739-1beb-43f6-be59-3156e9023fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.198149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b739-1beb-43f6-be59-3156e9023fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.198446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b739-1beb-43f6-be59-3156e9023fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.201985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba60417-5b20-41f5-b742-fb30f824f79a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.206921 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2720755-8ba1-49b4-aac8-077afce568c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.207242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2720755-8ba1-49b4-aac8-077afce568c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.207529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2720755-8ba1-49b4-aac8-077afce568c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.207793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2720755-8ba1-49b4-aac8-077afce568c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.208450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2720755-8ba1-49b4-aac8-077afce568c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.209193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799b739-1beb-43f6-be59-3156e9023fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.210219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2720755-8ba1-49b4-aac8-077afce568c3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.211454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799b739-1beb-43f6-be59-3156e9023fd0 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.226471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1040/2083] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:30.231611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2720755-8ba1-49b4-aac8-077afce568c3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.241277 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1044/2084] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:30.245427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2720755-8ba1-49b4-aac8-077afce568c3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.251382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.251969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.252251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.252689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] PATH_INFO: `/v3/projects/a030051075d44a58b68bc1ecae1fc0e2/users/d923b23500604bbdb1c8d2fe6a7d8812/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.257691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a030051075d44a58b68bc1ecae1fc0e2, user_id=d923b23500604bbdb1c8d2fe6a7d8812, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.260653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.275001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1041/2085] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:30 2022] PUT /identity/v3/projects/a030051075d44a58b68bc1ecae1fc0e2/users/d923b23500604bbdb1c8d2fe6a7d8812/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:30.285566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a959-7e08-4b3c-a310-bafc9716bb0b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.286392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a959-7e08-4b3c-a310-bafc9716bb0b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.286726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a959-7e08-4b3c-a310-bafc9716bb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.333427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b1c8a959-7e08-4b3c-a310-bafc9716bb0b None None] MFA Rules not processed for user `d923b23500604bbdb1c8d2fe6a7d8812`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:30.334597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b1c8a959-7e08-4b3c-a310-bafc9716bb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:30.356640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:30.413144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1045/2086] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:30.425280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.427403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:30.491894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ef18-e00f-41b3-aaa3-36134826eb47 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.497052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.497813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.498179 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.498490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.509288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.510877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.523627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1042/2087] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:30.527895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a959-7e08-4b3c-a310-bafc9716bb0b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.529291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b1c8a959-7e08-4b3c-a310-bafc9716bb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:30.610488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.611931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:30.619950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a959-7e08-4b3c-a310-bafc9716bb0b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.626425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.626801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2a68-bea9-4267-98bd-cffba26bfda2 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.626963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.627248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.627525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] PATH_INFO: `/v3/projects/675225c67ae94ffdb8d5b615ad5edac7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.629870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675225c67ae94ffdb8d5b615ad5edac7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.631914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.632366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.633090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.633472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.633817 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.635879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:30.642501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:30.703033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675225c67ae94ffdb8d5b615ad5edac7', 'request_id': 'req-6377a970-5d1f-46aa-97bb-945bee972e13'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.704063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.705566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.712912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675225c67ae94ffdb8d5b615ad5edac7', 'request_id': 'req-6377a970-5d1f-46aa-97bb-945bee972e13'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.716166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1043/2088] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:30.720262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675225c67ae94ffdb8d5b615ad5edac7', 'request_id': 'req-6377a970-5d1f-46aa-97bb-945bee972e13'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.734898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] The token cache is being invalidate because project 675225c67ae94ffdb8d5b615ad5edac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:30.735200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.735956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.738257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1046/2089] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:30 2022] DELETE /identity/v3/projects/675225c67ae94ffdb8d5b615ad5edac7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:30.742598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.763058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d5c3-b1b9-4060-b085-abbd13d5b7a7 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.856423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.856780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:30.857327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.857656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.857952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] PATH_INFO: `/v3/users/846b465df67b4b55848089525f8d2052` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.858258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:30.865160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846b465df67b4b55848089525f8d2052)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.867945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.892329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377a970-5d1f-46aa-97bb-945bee972e13 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:30.902567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:30.903710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:30.904553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:30.905073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] PATH_INFO: `/v3/users/9655dc19c19c4d459c73686060c84b76` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:30.906648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9655dc19c19c4d459c73686060c84b76)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:30.910078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:30.944695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846b465df67b4b55848089525f8d2052'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.955327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846b465df67b4b55848089525f8d2052'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.970509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846b465df67b4b55848089525f8d2052'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.971347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846b465df67b4b55848089525f8d2052'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.975086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:30.980137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57beb919-7e1d-40f3-8247-ca1b57631147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846b465df67b4b55848089525f8d2052'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.981247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9655dc19c19c4d459c73686060c84b76'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:30.989871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1044/2090] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:30 2022] DELETE /identity/v3/users/846b465df67b4b55848089525f8d2052 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:30.998191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9655dc19c19c4d459c73686060c84b76'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.008179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9655dc19c19c4d459c73686060c84b76'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.008999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9655dc19c19c4d459c73686060c84b76'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.016878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9655dc19c19c4d459c73686060c84b76'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.023878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1047/2091] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:30 2022] DELETE /identity/v3/users/9655dc19c19c4d459c73686060c84b76 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:31.028446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186f8f-cc09-4184-ab4c-bd310dbdf8c1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:31.028892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186f8f-cc09-4184-ab4c-bd310dbdf8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:31.029106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186f8f-cc09-4184-ab4c-bd310dbdf8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:31.051215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-30186f8f-cc09-4184-ab4c-bd310dbdf8c1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:31.052438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-30186f8f-cc09-4184-ab4c-bd310dbdf8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:31.074865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:31.134907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1045/2092] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:31.146844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:31.148599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:31.214466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833db9a-e73c-47e2-9ff1-3fc7800ac126 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:31.218604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f1af2-a673-4027-81d7-547758ddc8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:31.219463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f1af2-a673-4027-81d7-547758ddc8ab service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:31.219463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f1af2-a673-4027-81d7-547758ddc8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:31.219654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f1af2-a673-4027-81d7-547758ddc8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:31.230267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f1af2-a673-4027-81d7-547758ddc8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:31.231929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f1af2-a673-4027-81d7-547758ddc8ab service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:31.243546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1048/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:31.306510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30186f8f-cc09-4184-ab4c-bd310dbdf8c1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:31.308247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-30186f8f-cc09-4184-ab4c-bd310dbdf8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:31.322138 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30186f8f-cc09-4184-ab4c-bd310dbdf8c1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:31.328412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:31.329240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:31.329664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:31.330245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] PATH_INFO: `/v3/projects/6f0ef707de1e4aebb393cfb93dd691b2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:31.332191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0ef707de1e4aebb393cfb93dd691b2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:31.335977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:31.394040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0ef707de1e4aebb393cfb93dd691b2', 'request_id': 'req-603a6d05-15d3-4e70-b2f2-f18eea0beae1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.403188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0ef707de1e4aebb393cfb93dd691b2', 'request_id': 'req-603a6d05-15d3-4e70-b2f2-f18eea0beae1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.410756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0ef707de1e4aebb393cfb93dd691b2', 'request_id': 'req-603a6d05-15d3-4e70-b2f2-f18eea0beae1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.429782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] The token cache is being invalidate because project 6f0ef707de1e4aebb393cfb93dd691b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:31.430077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.430855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.433480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1046/2094] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:31 2022] DELETE /identity/v3/projects/6f0ef707de1e4aebb393cfb93dd691b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:31.437021 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f1af2-a673-4027-81d7-547758ddc8ab service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:31.447754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f1af2-a673-4027-81d7-547758ddc8ab service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:31.519068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:31.519844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:31.520197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:31.520543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] PATH_INFO: `/v3/users/a743534c234746359e75ab8a45401ec5` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:31.521782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a743534c234746359e75ab8a45401ec5)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:31.523789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:31.583492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a743534c234746359e75ab8a45401ec5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.598524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a743534c234746359e75ab8a45401ec5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.600649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:31.607100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a743534c234746359e75ab8a45401ec5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.608071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a743534c234746359e75ab8a45401ec5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.616851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a743534c234746359e75ab8a45401ec5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:31.624858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1049/2095] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:31 2022] DELETE /identity/v3/users/a743534c234746359e75ab8a45401ec5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:32.076977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:32.079553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:32.095124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:32.096599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:32.112545 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a6d05-15d3-4e70-b2f2-f18eea0beae1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:32.256704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf78947-3b1c-49bf-93a9-f37439f29534 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:32.266344 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:32.267036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.270065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.270361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] PATH_INFO: `/v3/projects/feca3fad66854c72a52bb6e4eecb7f9d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.272037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feca3fad66854c72a52bb6e4eecb7f9d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:32.274900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:32.322333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:32.323263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.323707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.324144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] PATH_INFO: `/v3/projects/2521abeba35b47a29481e72fd8d83c44` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.325304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2521abeba35b47a29481e72fd8d83c44)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:32.327464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:32.341908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feca3fad66854c72a52bb6e4eecb7f9d', 'request_id': 'req-4d89531f-0456-47a0-8480-d5c13e489bd0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.351189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feca3fad66854c72a52bb6e4eecb7f9d', 'request_id': 'req-4d89531f-0456-47a0-8480-d5c13e489bd0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.359155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feca3fad66854c72a52bb6e4eecb7f9d', 'request_id': 'req-4d89531f-0456-47a0-8480-d5c13e489bd0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.383120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] The token cache is being invalidate because project feca3fad66854c72a52bb6e4eecb7f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:32.383698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.385092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.390302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2521abeba35b47a29481e72fd8d83c44', 'request_id': 'req-b3f9207f-1824-4828-a07b-e2e4517027d0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.391796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1050/2096] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:32 2022] DELETE /identity/v3/projects/feca3fad66854c72a52bb6e4eecb7f9d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:32.392147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:32.397273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:32.400164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:32.400361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2521abeba35b47a29481e72fd8d83c44', 'request_id': 'req-b3f9207f-1824-4828-a07b-e2e4517027d0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.416164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2521abeba35b47a29481e72fd8d83c44', 'request_id': 'req-b3f9207f-1824-4828-a07b-e2e4517027d0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.432783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] The token cache is being invalidate because project 2521abeba35b47a29481e72fd8d83c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:32.433087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.433839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f9207f-1824-4828-a07b-e2e4517027d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.441457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1047/2097] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:32 2022] DELETE /identity/v3/projects/2521abeba35b47a29481e72fd8d83c44 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:32.447668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacdf1b-bb2f-4215-9f72-d0251b72899c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.448186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacdf1b-bb2f-4215-9f72-d0251b72899c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.449312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacdf1b-bb2f-4215-9f72-d0251b72899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.475826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1dacdf1b-bb2f-4215-9f72-d0251b72899c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:32.477609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1dacdf1b-bb2f-4215-9f72-d0251b72899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:32.484637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89531f-0456-47a0-8480-d5c13e489bd0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:32.514354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:32.586061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:32.586840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.587953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.588496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] PATH_INFO: `/v3/users/0d5fd2ee6d2243c9bb39c05ee8729760` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.590114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5fd2ee6d2243c9bb39c05ee8729760)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:32.593515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:32.596182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1048/2098] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:32.605374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472275b7-80c4-4552-806d-9917c7c5e168 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.605950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472275b7-80c4-4552-806d-9917c7c5e168 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.606438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472275b7-80c4-4552-806d-9917c7c5e168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.662939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-472275b7-80c4-4552-806d-9917c7c5e168 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:32.666493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-472275b7-80c4-4552-806d-9917c7c5e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:32.677901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5fd2ee6d2243c9bb39c05ee8729760'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.691419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1049/2099] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:32.691419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472275b7-80c4-4552-806d-9917c7c5e168 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:32.699105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472275b7-80c4-4552-806d-9917c7c5e168 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:32.702093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5fd2ee6d2243c9bb39c05ee8729760'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.704514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:32.705156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.705458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.705762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.706419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:32.706814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:32.708466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:32.710794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5fd2ee6d2243c9bb39c05ee8729760'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.712585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5fd2ee6d2243c9bb39c05ee8729760'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.720825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5fd2ee6d2243c9bb39c05ee8729760'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:32.725465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1050/2100] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:32.726931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:32.729250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:32.730390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1051/2101] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:32 2022] DELETE /identity/v3/users/0d5fd2ee6d2243c9bb39c05ee8729760 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:32.742641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0307f9-d95a-4128-bbf0-1d51dc2cca95 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:32.811318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca3d0-c15b-4497-a89f-6f3770545d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:32.812172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca3d0-c15b-4497-a89f-6f3770545d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.812521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca3d0-c15b-4497-a89f-6f3770545d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.813082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca3d0-c15b-4497-a89f-6f3770545d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.813873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aca3d0-c15b-4497-a89f-6f3770545d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:32.815966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aca3d0-c15b-4497-a89f-6f3770545d99 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:32.849013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1051/2102] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:32 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:32.854779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:32.867370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54d183-d8f1-4ec0-9a47-e49c50f4093e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:32.936701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713306bd-b8ba-4d67-88b0-6bebfce2487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:32.937493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713306bd-b8ba-4d67-88b0-6bebfce2487c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.938351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713306bd-b8ba-4d67-88b0-6bebfce2487c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.938351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713306bd-b8ba-4d67-88b0-6bebfce2487c admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.939017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713306bd-b8ba-4d67-88b0-6bebfce2487c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:32.941017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713306bd-b8ba-4d67-88b0-6bebfce2487c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:32.971158 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1052/2103] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:32 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:32.972357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca3d0-c15b-4497-a89f-6f3770545d99 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:32.988440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca3d0-c15b-4497-a89f-6f3770545d99 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:32.995712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:32.997099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:32.997391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:32.997779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:32.998439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:33.000110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:33.011149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1052/2104] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:33.016729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713306bd-b8ba-4d67-88b0-6bebfce2487c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:33.030045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713306bd-b8ba-4d67-88b0-6bebfce2487c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:33.036794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644a7b0-ea12-4972-b9dd-19348ee4d417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:33.037808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a7b0-ea12-4972-b9dd-19348ee4d417 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:33.037951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a7b0-ea12-4972-b9dd-19348ee4d417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:33.038152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a7b0-ea12-4972-b9dd-19348ee4d417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:33.039024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644a7b0-ea12-4972-b9dd-19348ee4d417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:33.041316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644a7b0-ea12-4972-b9dd-19348ee4d417 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:33.051203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:33.052992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:33.069108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1053/2105] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:33.073517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644a7b0-ea12-4972-b9dd-19348ee4d417 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:33.079804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086969-d76b-48a6-b8d4-c69699c2d8fd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:33.093365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:33.094201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:33.095782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:33.096196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] PATH_INFO: `/v3/projects/712625229c6842d884b7d6e39214c0a7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:33.097613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=712625229c6842d884b7d6e39214c0a7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:33.100010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:33.101980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644a7b0-ea12-4972-b9dd-19348ee4d417 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:33.112551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2dc95-bdf7-498a-b0d8-ec74270459e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:33.114010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2dc95-bdf7-498a-b0d8-ec74270459e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:33.114805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2dc95-bdf7-498a-b0d8-ec74270459e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:33.115262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2dc95-bdf7-498a-b0d8-ec74270459e5 admin admin] PATH_INFO: `/v3/projects/025d834d4e6c42af8c257ed024a873b3/users/bf5b2a3df1a24f2eba77ce14e9770905/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:33.142205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2dc95-bdf7-498a-b0d8-ec74270459e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025d834d4e6c42af8c257ed024a873b3, user_id=bf5b2a3df1a24f2eba77ce14e9770905, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:33.142616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:33.147184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2dc95-bdf7-498a-b0d8-ec74270459e5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:33.150423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:33.165036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712625229c6842d884b7d6e39214c0a7', 'request_id': 'req-965beba4-428a-4d81-9394-8764301d5a2c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.172757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1054/2106] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:33 2022] PUT /identity/v3/projects/025d834d4e6c42af8c257ed024a873b3/users/bf5b2a3df1a24f2eba77ce14e9770905/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:33.182366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712625229c6842d884b7d6e39214c0a7', 'request_id': 'req-965beba4-428a-4d81-9394-8764301d5a2c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.183650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090636fc-f233-41eb-a42d-60ed92f81f6e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:33.183941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090636fc-f233-41eb-a42d-60ed92f81f6e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:33.184216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090636fc-f233-41eb-a42d-60ed92f81f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:33.190522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712625229c6842d884b7d6e39214c0a7', 'request_id': 'req-965beba4-428a-4d81-9394-8764301d5a2c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.212665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] The token cache is being invalidate because project 712625229c6842d884b7d6e39214c0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:33.213103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.213815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.215852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1053/2107] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:33 2022] DELETE /identity/v3/projects/712625229c6842d884b7d6e39214c0a7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:33.219453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:33.221816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-090636fc-f233-41eb-a42d-60ed92f81f6e None None] MFA Rules not processed for user `bf5b2a3df1a24f2eba77ce14e9770905`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:33.223049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-090636fc-f233-41eb-a42d-60ed92f81f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:33.223855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:33.302033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1055/2108] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:33.321894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090636fc-f233-41eb-a42d-60ed92f81f6e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:33.323988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-090636fc-f233-41eb-a42d-60ed92f81f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:33.336892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965beba4-428a-4d81-9394-8764301d5a2c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:33.428877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:33.429681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:33.432581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:33.432875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] PATH_INFO: `/v3/users/63737ca52f6847c6ac835d5f76a96c56` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:33.434517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63737ca52f6847c6ac835d5f76a96c56)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:33.436632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:33.445819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090636fc-f233-41eb-a42d-60ed92f81f6e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:33.456441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:33.457195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:33.457606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:33.458395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:33.480596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:33.482988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:33.502540 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1056/2109] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:33.552297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63737ca52f6847c6ac835d5f76a96c56'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.571312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63737ca52f6847c6ac835d5f76a96c56'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.591987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:33.609526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63737ca52f6847c6ac835d5f76a96c56'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.613099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63737ca52f6847c6ac835d5f76a96c56'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.628442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63737ca52f6847c6ac835d5f76a96c56'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:33.649212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1054/2110] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:33 2022] DELETE /identity/v3/users/63737ca52f6847c6ac835d5f76a96c56 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:33.890033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:33.892247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:33.950633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c667f07-0ae8-4ec0-82bb-aa5d9c54997e service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.068054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.068698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.071276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.071589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] PATH_INFO: `/v3/users/9b9c627daafe4de7af2cea7d017c5260` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.078524 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9c627daafe4de7af2cea7d017c5260)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.096718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:34.151469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:34.153698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:34.180553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:34.194655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bda6d-e067-4112-9ddd-95ab2c0c5e7b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.205319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.206481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.208015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.209185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] PATH_INFO: `/v3/projects/142fe2ee4e1c45f5b29078f37a29d1a9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.212373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142fe2ee4e1c45f5b29078f37a29d1a9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.220514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:34.258324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9c627daafe4de7af2cea7d017c5260'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.284951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9c627daafe4de7af2cea7d017c5260'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.303144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9c627daafe4de7af2cea7d017c5260'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.305347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9c627daafe4de7af2cea7d017c5260'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.313282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142fe2ee4e1c45f5b29078f37a29d1a9', 'request_id': 'req-4ab98453-9489-4176-a05f-048b07e514e0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.321187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-edb79f71-7df6-4372-b15c-336ad683f796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9c627daafe4de7af2cea7d017c5260'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.326240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142fe2ee4e1c45f5b29078f37a29d1a9', 'request_id': 'req-4ab98453-9489-4176-a05f-048b07e514e0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.331773 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1057/2111] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:33 2022] DELETE /identity/v3/users/9b9c627daafe4de7af2cea7d017c5260 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:34.333248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7b22-ba21-45f8-8ab2-82931b251cec None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.333681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7b22-ba21-45f8-8ab2-82931b251cec None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.334052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7b22-ba21-45f8-8ab2-82931b251cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.334184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142fe2ee4e1c45f5b29078f37a29d1a9', 'request_id': 'req-4ab98453-9489-4176-a05f-048b07e514e0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.350303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] The token cache is being invalidate because project 142fe2ee4e1c45f5b29078f37a29d1a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:34.350763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.351405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4ab98453-9489-4176-a05f-048b07e514e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:34.353175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1055/2112] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:34 2022] DELETE /identity/v3/projects/142fe2ee4e1c45f5b29078f37a29d1a9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:34.354441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f15a7b22-ba21-45f8-8ab2-82931b251cec None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:34.356031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f15a7b22-ba21-45f8-8ab2-82931b251cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:34.357916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059208-a3e7-40fd-841e-3c6233950df2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.358196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059208-a3e7-40fd-841e-3c6233950df2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.358491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059208-a3e7-40fd-841e-3c6233950df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.381084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-39059208-a3e7-40fd-841e-3c6233950df2 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:34.382408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39059208-a3e7-40fd-841e-3c6233950df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:34.430507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1058/2113] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:34.442314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a7b22-ba21-45f8-8ab2-82931b251cec None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:34.443816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f15a7b22-ba21-45f8-8ab2-82931b251cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:34.451414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1056/2114] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:34.459071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c4b9c-a1fc-4784-a73c-898bf1954ddf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.459434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c4b9c-a1fc-4784-a73c-898bf1954ddf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.459814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c4b9c-a1fc-4784-a73c-898bf1954ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.481948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-808c4b9c-a1fc-4784-a73c-898bf1954ddf None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:34.483231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-808c4b9c-a1fc-4784-a73c-898bf1954ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:34.494537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1057/2115] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:34.498692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c4b9c-a1fc-4784-a73c-898bf1954ddf None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:34.510155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a7b22-ba21-45f8-8ab2-82931b251cec None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.513104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c4b9c-a1fc-4784-a73c-898bf1954ddf None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.513911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9d431-b3d8-4cb9-ac29-7adad7805ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.514789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d431-b3d8-4cb9-ac29-7adad7805ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.515066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d431-b3d8-4cb9-ac29-7adad7805ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.515337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d431-b3d8-4cb9-ac29-7adad7805ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.519564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.520320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.520704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.521079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.522072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:34.522474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.524841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:34.525388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9d431-b3d8-4cb9-ac29-7adad7805ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.526938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9d431-b3d8-4cb9-ac29-7adad7805ad3 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:34.538091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1059/2116] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:34.539342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1058/2117] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:14:34.544367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9d431-b3d8-4cb9-ac29-7adad7805ad3 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:34.555187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9d431-b3d8-4cb9-ac29-7adad7805ad3 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.560612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985e66b-430c-42b5-9ccb-e58a2c41db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.561377 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985e66b-430c-42b5-9ccb-e58a2c41db60 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.561975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985e66b-430c-42b5-9ccb-e58a2c41db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.561975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985e66b-430c-42b5-9ccb-e58a2c41db60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.562614 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985e66b-430c-42b5-9ccb-e58a2c41db60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.564508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985e66b-430c-42b5-9ccb-e58a2c41db60 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:34.598131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1060/2118] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:34 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:34.602267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:34.615822 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983334e0-665d-4b26-bc7a-7d7149bf9177 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.716256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:34.739503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d89a-7c9e-4997-889f-654fe06a3a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.740308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d89a-7c9e-4997-889f-654fe06a3a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.745886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d89a-7c9e-4997-889f-654fe06a3a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.746420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3d89a-7c9e-4997-889f-654fe06a3a96 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.747416 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d89a-7c9e-4997-889f-654fe06a3a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.749633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3d89a-7c9e-4997-889f-654fe06a3a96 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:34.785682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985e66b-430c-42b5-9ccb-e58a2c41db60 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:34.788317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1059/2119] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:34 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:34.800663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985e66b-430c-42b5-9ccb-e58a2c41db60 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.807459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839544e-e1ea-4644-bc8c-fed5f7ac7968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.808087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839544e-e1ea-4644-bc8c-fed5f7ac7968 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.808374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839544e-e1ea-4644-bc8c-fed5f7ac7968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.808646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839544e-e1ea-4644-bc8c-fed5f7ac7968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.809299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839544e-e1ea-4644-bc8c-fed5f7ac7968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.811030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839544e-e1ea-4644-bc8c-fed5f7ac7968 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:34.840712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1061/2120] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:34.844631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d89a-7c9e-4997-889f-654fe06a3a96 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:34.861354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3d89a-7c9e-4997-889f-654fe06a3a96 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.870326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7471b-bb99-4445-ab96-bf981b565725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.870950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7471b-bb99-4445-ab96-bf981b565725 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.871237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7471b-bb99-4445-ab96-bf981b565725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.871511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7471b-bb99-4445-ab96-bf981b565725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.872184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7471b-bb99-4445-ab96-bf981b565725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.877524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7471b-bb99-4445-ab96-bf981b565725 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:34.895131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1060/2121] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:34.895336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839544e-e1ea-4644-bc8c-fed5f7ac7968 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:34.914580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839544e-e1ea-4644-bc8c-fed5f7ac7968 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:34.928054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:34.931267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:34.931559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:34.931843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] PATH_INFO: `/v3/projects/4cd2493b36e5419a8fb09071d6949f96/users/bb268547ed6646568b0bfc860218f41e/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:34.955264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:34.980891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd2493b36e5419a8fb09071d6949f96, user_id=bb268547ed6646568b0bfc860218f41e, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:34.989654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:35.034360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1062/2122] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:34 2022] PUT /identity/v3/projects/4cd2493b36e5419a8fb09071d6949f96/users/bb268547ed6646568b0bfc860218f41e/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:35.046468 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5c73-ba0d-4a97-a13a-1b0d0bf95a1c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.047018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5c73-ba0d-4a97-a13a-1b0d0bf95a1c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.047373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a5c73-ba0d-4a97-a13a-1b0d0bf95a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.108586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-350a5c73-ba0d-4a97-a13a-1b0d0bf95a1c None None] MFA Rules not processed for user `bb268547ed6646568b0bfc860218f41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:35.109855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-350a5c73-ba0d-4a97-a13a-1b0d0bf95a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:35.222914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:35.225639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:35.255002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1061/2123] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:35.330961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a5c73-ba0d-4a97-a13a-1b0d0bf95a1c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:35.332450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-350a5c73-ba0d-4a97-a13a-1b0d0bf95a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:35.370939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3669a-6775-49a7-a711-711e01390663 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:35.376893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:35.378041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.378520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.379143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] PATH_INFO: `/v3/projects/5a42280dc7d14035bbe9e10e01483954` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.380335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a42280dc7d14035bbe9e10e01483954)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:35.383382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:35.409665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a5c73-ba0d-4a97-a13a-1b0d0bf95a1c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:35.413902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac0fb4-10b2-4efe-9585-9ffb2b90ac19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:35.414497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac0fb4-10b2-4efe-9585-9ffb2b90ac19 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.414781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac0fb4-10b2-4efe-9585-9ffb2b90ac19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.415088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac0fb4-10b2-4efe-9585-9ffb2b90ac19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.425863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac0fb4-10b2-4efe-9585-9ffb2b90ac19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:35.427839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac0fb4-10b2-4efe-9585-9ffb2b90ac19 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:35.441328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1062/2124] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:35.463532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a42280dc7d14035bbe9e10e01483954', 'request_id': 'req-04f2ddb1-5548-419a-977b-efd5b0c696b3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.474824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac0fb4-10b2-4efe-9585-9ffb2b90ac19 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:35.485557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a42280dc7d14035bbe9e10e01483954', 'request_id': 'req-04f2ddb1-5548-419a-977b-efd5b0c696b3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.488834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac0fb4-10b2-4efe-9585-9ffb2b90ac19 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:35.492043 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a42280dc7d14035bbe9e10e01483954', 'request_id': 'req-04f2ddb1-5548-419a-977b-efd5b0c696b3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.506014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] The token cache is being invalidate because project 5a42280dc7d14035bbe9e10e01483954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:35.506471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.507204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-04f2ddb1-5548-419a-977b-efd5b0c696b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.509334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1063/2125] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:35 2022] DELETE /identity/v3/projects/5a42280dc7d14035bbe9e10e01483954 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:35.514789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bb96-963e-456c-9bf1-24237da98098 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.515178 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bb96-963e-456c-9bf1-24237da98098 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.515574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bb96-963e-456c-9bf1-24237da98098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.544903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-38c5bb96-963e-456c-9bf1-24237da98098 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:35.547852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-38c5bb96-963e-456c-9bf1-24237da98098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:35.573950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:35.583962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:35.585018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.585664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.585912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] PATH_INFO: `/v3/users/bb268547ed6646568b0bfc860218f41e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.588040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb268547ed6646568b0bfc860218f41e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:35.590146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:35.657623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1064/2126] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:35.661669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389c02-c24b-49a1-a1cd-0843b7da4db9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.663213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389c02-c24b-49a1-a1cd-0843b7da4db9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.663424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389c02-c24b-49a1-a1cd-0843b7da4db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.667610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb268547ed6646568b0bfc860218f41e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.678626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb268547ed6646568b0bfc860218f41e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.701708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb268547ed6646568b0bfc860218f41e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.704853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb268547ed6646568b0bfc860218f41e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.713191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d4389c02-c24b-49a1-a1cd-0843b7da4db9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:35.714827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d4389c02-c24b-49a1-a1cd-0843b7da4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:35.730198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1065/2127] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:35.730198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648340b-2d81-4eef-b6ff-ba356d521529 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.730198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648340b-2d81-4eef-b6ff-ba356d521529 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.730198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648340b-2d81-4eef-b6ff-ba356d521529 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.733904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1066/2128] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:14:35.734663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648340b-2d81-4eef-b6ff-ba356d521529 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:35.741169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5d1820ce-c05f-4dcb-be72-0c2581198dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb268547ed6646568b0bfc860218f41e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:35.763160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1063/2129] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:35 2022] DELETE /identity/v3/users/bb268547ed6646568b0bfc860218f41e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:35.766797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648340b-2d81-4eef-b6ff-ba356d521529 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:35.771990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645786a-7801-41bd-be50-598dfbc34163 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.773250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645786a-7801-41bd-be50-598dfbc34163 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.773637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645786a-7801-41bd-be50-598dfbc34163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.786179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:35.810263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f645786a-7801-41bd-be50-598dfbc34163 None None] MFA Rules not processed for user `e7e636a8e4704971ae840035f3fc4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:35.811428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f645786a-7801-41bd-be50-598dfbc34163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:35.862807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6df80-a93e-4bf8-a883-9ec3f98ab4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:35.863609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6df80-a93e-4bf8-a883-9ec3f98ab4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.863995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6df80-a93e-4bf8-a883-9ec3f98ab4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.864805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6df80-a93e-4bf8-a883-9ec3f98ab4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.865653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6df80-a93e-4bf8-a883-9ec3f98ab4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:35.865943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6df80-a93e-4bf8-a883-9ec3f98ab4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:35.867911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6df80-a93e-4bf8-a883-9ec3f98ab4fb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:35.891048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1067/2130] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:35.891048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7a38-5090-46ff-adbd-b0a78254f902 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.891048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7a38-5090-46ff-adbd-b0a78254f902 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.891048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7a38-5090-46ff-adbd-b0a78254f902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.904413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1064/2131] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:35.905598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645786a-7801-41bd-be50-598dfbc34163 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:35.908111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f645786a-7801-41bd-be50-598dfbc34163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:35.925715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-252c7a38-5090-46ff-adbd-b0a78254f902 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:35.927570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-252c7a38-5090-46ff-adbd-b0a78254f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:35.934746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645786a-7801-41bd-be50-598dfbc34163 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:35.940048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:35.940689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.944333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1068/2132] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:35.944509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.944509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] PATH_INFO: `/v3/users/5cea7737368147a78c91fd4b89139ff6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.945138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c7a38-5090-46ff-adbd-b0a78254f902 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:35.945235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cea7737368147a78c91fd4b89139ff6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:35.945521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:35.964639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c7a38-5090-46ff-adbd-b0a78254f902 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:35.971133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:35.972004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:35.973466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:35.973879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:35.974636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:35.981734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.016742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cea7737368147a78c91fd4b89139ff6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.018537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1069/2133] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:35 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:36.022589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.029617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.037108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cea7737368147a78c91fd4b89139ff6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.051769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:36.055154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cea7737368147a78c91fd4b89139ff6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.057097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cea7737368147a78c91fd4b89139ff6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.065680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cea7737368147a78c91fd4b89139ff6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.073210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1065/2134] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:35 2022] DELETE /identity/v3/users/5cea7737368147a78c91fd4b89139ff6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:36.074335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.076125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.142507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d73df-c59f-4d6e-a3cf-69ee97fbea92 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.185073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb405-676d-4bbc-bf3c-6b8daf761b46 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.188916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.189558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.189838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.190194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.192118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.225892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.226451 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.226735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.227012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.230499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.242362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.244812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.255839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1070/2135] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:36.256668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.258059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.273203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:36.285730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.287705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.306460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1066/2136] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:36.363635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.365939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.394892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f004-ee06-4380-b402-16591cc6a42b service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.401741 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.402500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.402711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.403065 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] PATH_INFO: `/v3/projects/889f6b4456c44a868fe8a44cd60c6808` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.405057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=889f6b4456c44a868fe8a44cd60c6808)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.407286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.417243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5f19c-a0e0-4294-ad90-06f6f3dd62f5 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.424463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a743d-b49b-468f-9506-860c960ebf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.425275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a743d-b49b-468f-9506-860c960ebf72 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.425643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a743d-b49b-468f-9506-860c960ebf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.426159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a743d-b49b-468f-9506-860c960ebf72 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.426887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a743d-b49b-468f-9506-860c960ebf72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.429669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a743d-b49b-468f-9506-860c960ebf72 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.456014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1071/2137] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:36 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:36.460243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a743d-b49b-468f-9506-860c960ebf72 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.471627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a743d-b49b-468f-9506-860c960ebf72 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.477306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889f6b4456c44a868fe8a44cd60c6808', 'request_id': 'req-ebf26bf3-8586-4f19-80eb-b03566c16c10'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.485342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889f6b4456c44a868fe8a44cd60c6808', 'request_id': 'req-ebf26bf3-8586-4f19-80eb-b03566c16c10'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.492334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889f6b4456c44a868fe8a44cd60c6808', 'request_id': 'req-ebf26bf3-8586-4f19-80eb-b03566c16c10'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.507871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] The token cache is being invalidate because project 889f6b4456c44a868fe8a44cd60c6808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:36.508165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.509496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ebf26bf3-8586-4f19-80eb-b03566c16c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:36.511270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1067/2138] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:36 2022] DELETE /identity/v3/projects/889f6b4456c44a868fe8a44cd60c6808 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:36.516186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253cb7-b767-4690-bfb8-61c6a234add3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.516605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253cb7-b767-4690-bfb8-61c6a234add3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.516979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69253cb7-b767-4690-bfb8-61c6a234add3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.539315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-69253cb7-b767-4690-bfb8-61c6a234add3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:36.540834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-69253cb7-b767-4690-bfb8-61c6a234add3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.543447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.544200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.544505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.544780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.545489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.547283 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.559954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1068/2139] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:36.562252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb0b5-e8eb-40f2-9159-871937fc17ba None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.562634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb0b5-e8eb-40f2-9159-871937fc17ba None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.563088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb0b5-e8eb-40f2-9159-871937fc17ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.563466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1072/2140] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:36.564290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.566110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.579527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f11657-5a30-4a50-9ec9-805683254531 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.584964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e914a-fc29-4fc5-ac68-dec4d2f32bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.585750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e914a-fc29-4fc5-ac68-dec4d2f32bef admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.585951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e914a-fc29-4fc5-ac68-dec4d2f32bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.586231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e914a-fc29-4fc5-ac68-dec4d2f32bef admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.586983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e914a-fc29-4fc5-ac68-dec4d2f32bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.587632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-81ccb0b5-e8eb-40f2-9159-871937fc17ba None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:36.588983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-81ccb0b5-e8eb-40f2-9159-871937fc17ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.589277 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e914a-fc29-4fc5-ac68-dec4d2f32bef admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.601790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1069/2141] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:36.605877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1073/2142] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:36.606239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb0b5-e8eb-40f2-9159-871937fc17ba None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.607044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e914a-fc29-4fc5-ac68-dec4d2f32bef admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.612917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:36.617804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb0b5-e8eb-40f2-9159-871937fc17ba None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.619796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e914a-fc29-4fc5-ac68-dec4d2f32bef admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.625776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb98f-4f54-41f1-8cd2-6fba7d60237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.626449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb98f-4f54-41f1-8cd2-6fba7d60237e admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.626730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb98f-4f54-41f1-8cd2-6fba7d60237e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.627008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb98f-4f54-41f1-8cd2-6fba7d60237e admin admin] PATH_INFO: `/v3/projects/48058e2ed13c42888f79e67c1b074368/users/96d57472de274ccabb02dc210283b4be/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.627414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.628299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.629025 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.629974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.632107 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:36.632742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.635348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.644177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb98f-4f54-41f1-8cd2-6fba7d60237e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48058e2ed13c42888f79e67c1b074368, user_id=96d57472de274ccabb02dc210283b4be, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.647018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb98f-4f54-41f1-8cd2-6fba7d60237e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.657258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1070/2143] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:36.659407 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.667644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1074/2144] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:36 2022] PUT /identity/v3/projects/48058e2ed13c42888f79e67c1b074368/users/96d57472de274ccabb02dc210283b4be/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:36.672251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848e38c-6993-4676-8370-d62e30e5b756 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.672799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848e38c-6993-4676-8370-d62e30e5b756 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.673265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848e38c-6993-4676-8370-d62e30e5b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.674236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f87b9-36e5-47ee-b261-a30fb6ec4f3c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.694550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d848e38c-6993-4676-8370-d62e30e5b756 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:36.695859 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d848e38c-6993-4676-8370-d62e30e5b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.750710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39706-cd96-40b1-b039-41713fb02852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.751767 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39706-cd96-40b1-b039-41713fb02852 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.752033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39706-cd96-40b1-b039-41713fb02852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.752308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39706-cd96-40b1-b039-41713fb02852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.752940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e39706-cd96-40b1-b039-41713fb02852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.755160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e39706-cd96-40b1-b039-41713fb02852 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.764455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1075/2145] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:36.778485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848e38c-6993-4676-8370-d62e30e5b756 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.781834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d848e38c-6993-4676-8370-d62e30e5b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.788891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:36.805527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1071/2146] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:36 2022] POST /identity/v3/projects => generated 405 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:36.809638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39706-cd96-40b1-b039-41713fb02852 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.873305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848e38c-6993-4676-8370-d62e30e5b756 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.882554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39706-cd96-40b1-b039-41713fb02852 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.888862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87f630-adf2-4bb2-b929-7ad575e431bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.889438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f630-adf2-4bb2-b929-7ad575e431bf admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.889836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f630-adf2-4bb2-b929-7ad575e431bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.890125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87f630-adf2-4bb2-b929-7ad575e431bf admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.890861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87f630-adf2-4bb2-b929-7ad575e431bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.893308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87f630-adf2-4bb2-b929-7ad575e431bf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.925582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1072/2147] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:36 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:36.926405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87f630-adf2-4bb2-b929-7ad575e431bf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.937588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.938328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.938613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.938889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.941859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87f630-adf2-4bb2-b929-7ad575e431bf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.947317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98611b3-5b49-419d-80f2-0afe3d0770ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.948034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98611b3-5b49-419d-80f2-0afe3d0770ff admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.948309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98611b3-5b49-419d-80f2-0afe3d0770ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.948579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98611b3-5b49-419d-80f2-0afe3d0770ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.949240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98611b3-5b49-419d-80f2-0afe3d0770ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.949680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.950877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98611b3-5b49-419d-80f2-0afe3d0770ff admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.951262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.963131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1076/2148] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:36.963995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.964186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1073/2149] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:36.965458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:36.967984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98611b3-5b49-419d-80f2-0afe3d0770ff admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:36.978258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031eb7-653f-4b21-98c4-b8dc7946524f service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.979750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98611b3-5b49-419d-80f2-0afe3d0770ff admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:36.983655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.984303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.984654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.984993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] PATH_INFO: `/v3/projects/4cd2493b36e5419a8fb09071d6949f96` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.987298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd2493b36e5419a8fb09071d6949f96)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.988581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc8e83-b0a8-4ec2-8938-8488b851e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:36.989263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8e83-b0a8-4ec2-8938-8488b851e919 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:36.989647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8e83-b0a8-4ec2-8938-8488b851e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:36.989905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:36.990037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8e83-b0a8-4ec2-8938-8488b851e919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:36.992460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc8e83-b0a8-4ec2-8938-8488b851e919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:36.994840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc8e83-b0a8-4ec2-8938-8488b851e919 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:37.007778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1074/2150] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:37.013892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc8e83-b0a8-4ec2-8938-8488b851e919 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:37.027244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc8e83-b0a8-4ec2-8938-8488b851e919 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:37.041211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f652f5c-5733-4284-8b66-c36c44a71255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:37.042499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652f5c-5733-4284-8b66-c36c44a71255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:37.042987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652f5c-5733-4284-8b66-c36c44a71255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:37.043427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652f5c-5733-4284-8b66-c36c44a71255 admin admin] PATH_INFO: `/v3/projects/4305f51eef3e43a492e094c3f19c1a6e/users/538547b901954a408260f05b78e67ef2/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:37.067216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd2493b36e5419a8fb09071d6949f96', 'request_id': 'req-74899bf0-9c09-49d8-846a-1c68eeadda49'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:37.067636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f652f5c-5733-4284-8b66-c36c44a71255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4305f51eef3e43a492e094c3f19c1a6e, user_id=538547b901954a408260f05b78e67ef2, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:37.072242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f652f5c-5733-4284-8b66-c36c44a71255 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:37.077060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd2493b36e5419a8fb09071d6949f96', 'request_id': 'req-74899bf0-9c09-49d8-846a-1c68eeadda49'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:37.085838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd2493b36e5419a8fb09071d6949f96', 'request_id': 'req-74899bf0-9c09-49d8-846a-1c68eeadda49'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:37.091757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1075/2151] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:37 2022] PUT /identity/v3/projects/4305f51eef3e43a492e094c3f19c1a6e/users/538547b901954a408260f05b78e67ef2/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:37.097670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b656-4f49-4cca-9ab4-5523d28051d8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:37.098002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b656-4f49-4cca-9ab4-5523d28051d8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:37.098403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b656-4f49-4cca-9ab4-5523d28051d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:37.110769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] The token cache is being invalidate because project 4cd2493b36e5419a8fb09071d6949f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:37.111426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:37.112804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:37.122979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-52c5b656-4f49-4cca-9ab4-5523d28051d8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:37.124739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-52c5b656-4f49-4cca-9ab4-5523d28051d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:37.129372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1077/2152] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:36 2022] DELETE /identity/v3/projects/4cd2493b36e5419a8fb09071d6949f96 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:37.188577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:37.285658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1076/2153] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:37.297933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:37.300024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:37.385588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:37.395615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74899bf0-9c09-49d8-846a-1c68eeadda49 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:37.464878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:37.465650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:37.466030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:37.466397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:37.475754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:37.477289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:37.488004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1078/2154] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:38.824252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606d90-c248-4dc0-a037-53acb711361a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:38.824692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606d90-c248-4dc0-a037-53acb711361a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:38.824803 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606d90-c248-4dc0-a037-53acb711361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:38.883718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a4606d90-c248-4dc0-a037-53acb711361a None None] MFA Rules not processed for user `538547b901954a408260f05b78e67ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:38.885310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a4606d90-c248-4dc0-a037-53acb711361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:38.982947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1077/2155] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:38.987218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:38.988659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:39.025912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6a58a-17fa-4634-b59d-30dcb1ff83ca service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:39.033309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af89d-6ee2-40a9-812d-519d875a36af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:39.034107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af89d-6ee2-40a9-812d-519d875a36af admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:39.034454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af89d-6ee2-40a9-812d-519d875a36af admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:39.034797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af89d-6ee2-40a9-812d-519d875a36af admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:39.035975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5af89d-6ee2-40a9-812d-519d875a36af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:39.037576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5af89d-6ee2-40a9-812d-519d875a36af admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:39.088566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1079/2156] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:38 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:39.089009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4606d90-c248-4dc0-a037-53acb711361a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:39.101558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4606d90-c248-4dc0-a037-53acb711361a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:39.177143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd435b6-6e76-41f2-bfc7-d77651476bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:39.177809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd435b6-6e76-41f2-bfc7-d77651476bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:39.178216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd435b6-6e76-41f2-bfc7-d77651476bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:39.178494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd435b6-6e76-41f2-bfc7-d77651476bdc admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:39.179140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd435b6-6e76-41f2-bfc7-d77651476bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:39.181165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd435b6-6e76-41f2-bfc7-d77651476bdc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:39.213907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1078/2157] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:39 2022] POST /identity/v3/users => generated 308 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:39.215381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af89d-6ee2-40a9-812d-519d875a36af admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:39.229727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af89d-6ee2-40a9-812d-519d875a36af admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:39.237007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134224-61dc-46c4-bb91-45df1f3f3c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:39.237751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134224-61dc-46c4-bb91-45df1f3f3c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:39.238108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134224-61dc-46c4-bb91-45df1f3f3c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:39.238462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2134224-61dc-46c4-bb91-45df1f3f3c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:39.239178 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2134224-61dc-46c4-bb91-45df1f3f3c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:39.241512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2134224-61dc-46c4-bb91-45df1f3f3c59 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:39.260691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1080/2158] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:39.261243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd435b6-6e76-41f2-bfc7-d77651476bdc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:39.272499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd435b6-6e76-41f2-bfc7-d77651476bdc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:39.278000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892a011-3620-41c9-a532-3ca0c2553999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:39.278609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892a011-3620-41c9-a532-3ca0c2553999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:39.279038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892a011-3620-41c9-a532-3ca0c2553999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:39.279316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892a011-3620-41c9-a532-3ca0c2553999 admin admin] PATH_INFO: `/v3/projects/39c37f2eb9224c63aa94357e6d5779dc/users/643ac6b67034418aa74b6cdc944ef924/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:39.295482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892a011-3620-41c9-a532-3ca0c2553999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c37f2eb9224c63aa94357e6d5779dc, user_id=643ac6b67034418aa74b6cdc944ef924, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:39.298346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892a011-3620-41c9-a532-3ca0c2553999 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:39.314101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1079/2159] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:39 2022] PUT /identity/v3/projects/39c37f2eb9224c63aa94357e6d5779dc/users/643ac6b67034418aa74b6cdc944ef924/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:39.317980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134224-61dc-46c4-bb91-45df1f3f3c59 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:39.330841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2134224-61dc-46c4-bb91-45df1f3f3c59 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:39.392046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb1e5-9c88-47fb-8f7a-f922a3621d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:39.392685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb1e5-9c88-47fb-8f7a-f922a3621d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:39.392973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb1e5-9c88-47fb-8f7a-f922a3621d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:39.393247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb1e5-9c88-47fb-8f7a-f922a3621d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:39.393943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acb1e5-9c88-47fb-8f7a-f922a3621d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:39.395573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acb1e5-9c88-47fb-8f7a-f922a3621d36 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:39.407281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1081/2160] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:39.411621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892a011-3620-41c9-a532-3ca0c2553999 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:39.421988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892a011-3620-41c9-a532-3ca0c2553999 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:39.426633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadddf1-2922-4da1-8796-e2c921655d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:39.427278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadddf1-2922-4da1-8796-e2c921655d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:39.427565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadddf1-2922-4da1-8796-e2c921655d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:39.427839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadddf1-2922-4da1-8796-e2c921655d58 admin admin] PATH_INFO: `/v3/projects/39c37f2eb9224c63aa94357e6d5779dc/users/643ac6b67034418aa74b6cdc944ef924/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:39.429860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadddf1-2922-4da1-8796-e2c921655d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c37f2eb9224c63aa94357e6d5779dc, user_id=643ac6b67034418aa74b6cdc944ef924, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:39.433136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afadddf1-2922-4da1-8796-e2c921655d58 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:39.443854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1080/2161] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:39 2022] PUT /identity/v3/projects/39c37f2eb9224c63aa94357e6d5779dc/users/643ac6b67034418aa74b6cdc944ef924/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:40.413505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dcc76-20ce-4460-ae43-9b4dca75930e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:40.414026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dcc76-20ce-4460-ae43-9b4dca75930e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:40.414365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dcc76-20ce-4460-ae43-9b4dca75930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:40.475994 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-005dcc76-20ce-4460-ae43-9b4dca75930e None None] MFA Rules not processed for user `643ac6b67034418aa74b6cdc944ef924`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:40.477665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-005dcc76-20ce-4460-ae43-9b4dca75930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:40.622750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:40.642170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1082/2162] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:41.347342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf2f7-8d71-4e0c-ba6d-b919ce75f1b0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:41.347878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf2f7-8d71-4e0c-ba6d-b919ce75f1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:41.348039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf2f7-8d71-4e0c-ba6d-b919ce75f1b0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:41.349997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1081/2163] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:14:41.357217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb48e0-f657-4f46-bd1a-aef16fd8a492 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:41.357563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb48e0-f657-4f46-bd1a-aef16fd8a492 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:41.357843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb48e0-f657-4f46-bd1a-aef16fd8a492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:41.401447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-12cb48e0-f657-4f46-bd1a-aef16fd8a492 None None] MFA Rules not processed for user `e7e636a8e4704971ae840035f3fc4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:41.405193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-12cb48e0-f657-4f46-bd1a-aef16fd8a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:41.536618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1083/2164] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:14:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:41.548627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdf2f7-8d71-4e0c-ba6d-b919ce75f1b0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:41.550931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a4cdf2f7-8d71-4e0c-ba6d-b919ce75f1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:41.579577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:41.589664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdf2f7-8d71-4e0c-ba6d-b919ce75f1b0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:41.599166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c04875-a958-4dfc-a621-bf1684f941be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:41.599802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04875-a958-4dfc-a621-bf1684f941be service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:41.600096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04875-a958-4dfc-a621-bf1684f941be service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:41.600478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04875-a958-4dfc-a621-bf1684f941be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:41.637115 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c04875-a958-4dfc-a621-bf1684f941be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:41.644177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c04875-a958-4dfc-a621-bf1684f941be service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:41.682339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1082/2165] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:42.633572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb48e0-f657-4f46-bd1a-aef16fd8a492 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:42.713909 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb48e0-f657-4f46-bd1a-aef16fd8a492 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:42.720629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:42.721725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:42.722297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:42.722790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] PATH_INFO: `/v3/users/538547b901954a408260f05b78e67ef2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:42.724204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=538547b901954a408260f05b78e67ef2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:42.726299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:42.824913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538547b901954a408260f05b78e67ef2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:42.844170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538547b901954a408260f05b78e67ef2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:42.859975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538547b901954a408260f05b78e67ef2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:42.860951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538547b901954a408260f05b78e67ef2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:42.880000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538547b901954a408260f05b78e67ef2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:42.888453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1084/2166] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:42 2022] DELETE /identity/v3/users/538547b901954a408260f05b78e67ef2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:43.083804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901558d-2904-4f4e-897e-906a4586fd6d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.084216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901558d-2904-4f4e-897e-906a4586fd6d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.084410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901558d-2904-4f4e-897e-906a4586fd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.132027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c901558d-2904-4f4e-897e-906a4586fd6d None None] MFA Rules not processed for user `96d57472de274ccabb02dc210283b4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:43.133599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c901558d-2904-4f4e-897e-906a4586fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:43.246360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1083/2167] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:43.247232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:43.248733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:43.262555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:43.304955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901558d-2904-4f4e-897e-906a4586fd6d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:43.307826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c901558d-2904-4f4e-897e-906a4586fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:43.383185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080d2e-b87e-4143-a8d1-3a7a849ccfdf admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:43.388812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cce92-3012-44f4-82f2-9750b9b1bb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:43.389528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cce92-3012-44f4-82f2-9750b9b1bb97 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.389752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cce92-3012-44f4-82f2-9750b9b1bb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.390029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cce92-3012-44f4-82f2-9750b9b1bb97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.390716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cce92-3012-44f4-82f2-9750b9b1bb97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:43.392605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cce92-3012-44f4-82f2-9750b9b1bb97 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:43.431919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901558d-2904-4f4e-897e-906a4586fd6d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:43.432936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1085/2168] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:43 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:43.439036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cce92-3012-44f4-82f2-9750b9b1bb97 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:43.528977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:43.529932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.530328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.530738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] PATH_INFO: `/v3/projects/4305f51eef3e43a492e094c3f19c1a6e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.532444 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4305f51eef3e43a492e094c3f19c1a6e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:43.534837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:43.561214 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cce92-3012-44f4-82f2-9750b9b1bb97 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:43.566176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f38f-152a-42d8-9e25-9a5135c84228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:43.566844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f38f-152a-42d8-9e25-9a5135c84228 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.567079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f38f-152a-42d8-9e25-9a5135c84228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.567391 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f38f-152a-42d8-9e25-9a5135c84228 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.567993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74f38f-152a-42d8-9e25-9a5135c84228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:43.570270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74f38f-152a-42d8-9e25-9a5135c84228 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:43.599320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1086/2169] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:43 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:43.602895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f38f-152a-42d8-9e25-9a5135c84228 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:43.645481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f38f-152a-42d8-9e25-9a5135c84228 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:43.659253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903511e-214d-4bfd-8abf-8450fe2a4de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:43.660786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903511e-214d-4bfd-8abf-8450fe2a4de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.661318 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903511e-214d-4bfd-8abf-8450fe2a4de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.661832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903511e-214d-4bfd-8abf-8450fe2a4de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.662958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903511e-214d-4bfd-8abf-8450fe2a4de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:43.665839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903511e-214d-4bfd-8abf-8450fe2a4de4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:43.669527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:43.678870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1087/2170] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:43.688104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903511e-214d-4bfd-8abf-8450fe2a4de4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:43.708299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903511e-214d-4bfd-8abf-8450fe2a4de4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:43.718149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4305f51eef3e43a492e094c3f19c1a6e', 'request_id': 'req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:43.730412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4305f51eef3e43a492e094c3f19c1a6e', 'request_id': 'req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:43.738955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4305f51eef3e43a492e094c3f19c1a6e', 'request_id': 'req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:43.764888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] The token cache is being invalidate because project 4305f51eef3e43a492e094c3f19c1a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:43.765210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:43.765940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:43.767938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1084/2171] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:43 2022] DELETE /identity/v3/projects/4305f51eef3e43a492e094c3f19c1a6e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:43.771600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:43.773235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:43.783722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:43.784541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.784732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.785078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] PATH_INFO: `/v3/projects/4e87750a9b3d4db3aaad76c99d7e0b67/users/4afc7b71b36f424abab51cf03abba5e7/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.806071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e87750a9b3d4db3aaad76c99d7e0b67, user_id=4afc7b71b36f424abab51cf03abba5e7, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:43.810338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:43.814670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:43.830118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1088/2172] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:43 2022] PUT /identity/v3/projects/4e87750a9b3d4db3aaad76c99d7e0b67/users/4afc7b71b36f424abab51cf03abba5e7/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:43.833941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:43.835971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:43.860927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce95f37-28cd-4eb2-8ee2-43a2bfe34d0f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:43.905910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e11bb-9704-4ad0-b168-d487f36163e9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:43.910999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022503e-9169-484c-b393-2eb3022c848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:43.911702 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022503e-9169-484c-b393-2eb3022c848b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.912048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022503e-9169-484c-b393-2eb3022c848b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.912401 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022503e-9169-484c-b393-2eb3022c848b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.913146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022503e-9169-484c-b393-2eb3022c848b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:43.915095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022503e-9169-484c-b393-2eb3022c848b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:43.924298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:43.924895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.925080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.925487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] PATH_INFO: `/v3/users/643ac6b67034418aa74b6cdc944ef924` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.926756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=643ac6b67034418aa74b6cdc944ef924)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:43.932095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1089/2173] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:43.932232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:43.933466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022503e-9169-484c-b393-2eb3022c848b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:43.943928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022503e-9169-484c-b393-2eb3022c848b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:43.949655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:43.950320 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:43.950600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:43.950877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] PATH_INFO: `/v3/projects/4e87750a9b3d4db3aaad76c99d7e0b67/users/4afc7b71b36f424abab51cf03abba5e7/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:43.952863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e87750a9b3d4db3aaad76c99d7e0b67, user_id=4afc7b71b36f424abab51cf03abba5e7, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:43.955586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:43.967931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1090/2174] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:43 2022] PUT /identity/v3/projects/4e87750a9b3d4db3aaad76c99d7e0b67/users/4afc7b71b36f424abab51cf03abba5e7/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:43.990885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643ac6b67034418aa74b6cdc944ef924'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.000082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643ac6b67034418aa74b6cdc944ef924'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.009365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:44.015266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643ac6b67034418aa74b6cdc944ef924'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.016358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643ac6b67034418aa74b6cdc944ef924'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.025816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6b50b39c-6a07-4a7b-bfac-b8f0495d8c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643ac6b67034418aa74b6cdc944ef924'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.032725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1085/2175] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:43 2022] DELETE /identity/v3/users/643ac6b67034418aa74b6cdc944ef924 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:44.256374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:44.259175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:44.375857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55584125-bf6a-4c4e-b9ee-c6f41e03e509 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:44.490115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:44.490966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:44.491223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:44.491585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] PATH_INFO: `/v3/projects/39c37f2eb9224c63aa94357e6d5779dc` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:44.495770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c37f2eb9224c63aa94357e6d5779dc)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:44.498438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:44.575922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:44.611462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c37f2eb9224c63aa94357e6d5779dc', 'request_id': 'req-733ad903-7361-4d52-9250-46ec041d4a47'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.621256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c37f2eb9224c63aa94357e6d5779dc', 'request_id': 'req-733ad903-7361-4d52-9250-46ec041d4a47'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.629659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c37f2eb9224c63aa94357e6d5779dc', 'request_id': 'req-733ad903-7361-4d52-9250-46ec041d4a47'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.649510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] The token cache is being invalidate because project 39c37f2eb9224c63aa94357e6d5779dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:44.650530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.651689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-733ad903-7361-4d52-9250-46ec041d4a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:44.658972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af6bc9-696d-46c7-a210-605a4463982d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:44.659847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af6bc9-696d-46c7-a210-605a4463982d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:44.660296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af6bc9-696d-46c7-a210-605a4463982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:44.663553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1091/2176] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:44 2022] DELETE /identity/v3/projects/39c37f2eb9224c63aa94357e6d5779dc => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:44.686875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e8af6bc9-696d-46c7-a210-605a4463982d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:44.688581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e8af6bc9-696d-46c7-a210-605a4463982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:44.787613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1086/2177] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:44.789607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62823c-0f77-41f2-830c-711bbac56b3e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:44.789900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62823c-0f77-41f2-830c-711bbac56b3e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:44.790263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62823c-0f77-41f2-830c-711bbac56b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:44.814321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7d62823c-0f77-41f2-830c-711bbac56b3e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:44.816369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7d62823c-0f77-41f2-830c-711bbac56b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:44.835640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1092/2178] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:44.839633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af6bc9-696d-46c7-a210-605a4463982d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:44.853663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af6bc9-696d-46c7-a210-605a4463982d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:44.859052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:44.859937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:44.860367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:44.860644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:44.861313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:44.861655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:44.864000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:44.885891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1087/2179] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:44.890496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62823c-0f77-41f2-830c-711bbac56b3e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:44.902442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62823c-0f77-41f2-830c-711bbac56b3e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:44.912170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ffe42-5c8a-41e1-8784-a466b1b1a86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:44.912814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ffe42-5c8a-41e1-8784-a466b1b1a86c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:44.913099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ffe42-5c8a-41e1-8784-a466b1b1a86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:44.913370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ffe42-5c8a-41e1-8784-a466b1b1a86c admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:44.914045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ffe42-5c8a-41e1-8784-a466b1b1a86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:44.922598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ffe42-5c8a-41e1-8784-a466b1b1a86c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:44.969441 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1093/2180] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:44 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:14:44.978549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:44.998108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c028ed8-8bc1-4844-9faf-15c505ba2836 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.122103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e561477-bfc4-4afe-8210-d9dce5065742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:45.123298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e561477-bfc4-4afe-8210-d9dce5065742 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.123613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e561477-bfc4-4afe-8210-d9dce5065742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.124168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e561477-bfc4-4afe-8210-d9dce5065742 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.124906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e561477-bfc4-4afe-8210-d9dce5065742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:45.128537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e561477-bfc4-4afe-8210-d9dce5065742 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:45.155812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1088/2181] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:44 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:45.160019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ffe42-5c8a-41e1-8784-a466b1b1a86c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:45.171078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ffe42-5c8a-41e1-8784-a466b1b1a86c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.176286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8198d-e39b-4a6b-991e-a9fc4c302b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:45.176901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8198d-e39b-4a6b-991e-a9fc4c302b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.177190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8198d-e39b-4a6b-991e-a9fc4c302b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.177505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8198d-e39b-4a6b-991e-a9fc4c302b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.178187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8198d-e39b-4a6b-991e-a9fc4c302b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:45.179892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8198d-e39b-4a6b-991e-a9fc4c302b6a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:45.193465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1094/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:45.198585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e561477-bfc4-4afe-8210-d9dce5065742 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:45.211384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e561477-bfc4-4afe-8210-d9dce5065742 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.216837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b101489-8b21-4f52-a0f7-9806cbb461af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:45.217481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101489-8b21-4f52-a0f7-9806cbb461af admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.217765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101489-8b21-4f52-a0f7-9806cbb461af admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.218038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101489-8b21-4f52-a0f7-9806cbb461af admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.218725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b101489-8b21-4f52-a0f7-9806cbb461af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:45.220416 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b101489-8b21-4f52-a0f7-9806cbb461af admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:45.232551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1089/2183] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:45.237146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8198d-e39b-4a6b-991e-a9fc4c302b6a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:45.261346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8198d-e39b-4a6b-991e-a9fc4c302b6a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.268121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656ce9b-92c6-48c5-ad75-4afe094407c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:45.268856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656ce9b-92c6-48c5-ad75-4afe094407c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.269168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656ce9b-92c6-48c5-ad75-4afe094407c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.269882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656ce9b-92c6-48c5-ad75-4afe094407c2 admin admin] PATH_INFO: `/v3/projects/4eb7e5bef6ee4d4d8ab489519fe60d71/users/69bde2a239b546efa257a19f498d9175/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.295535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656ce9b-92c6-48c5-ad75-4afe094407c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb7e5bef6ee4d4d8ab489519fe60d71, user_id=69bde2a239b546efa257a19f498d9175, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:45.298939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656ce9b-92c6-48c5-ad75-4afe094407c2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:45.321446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1095/2184] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:45 2022] PUT /identity/v3/projects/4eb7e5bef6ee4d4d8ab489519fe60d71/users/69bde2a239b546efa257a19f498d9175/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:45.331922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7283-2274-46d6-ae93-19bd057c5879 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.332208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7283-2274-46d6-ae93-19bd057c5879 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.332564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7283-2274-46d6-ae93-19bd057c5879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.365349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-53ab7283-2274-46d6-ae93-19bd057c5879 None None] MFA Rules not processed for user `69bde2a239b546efa257a19f498d9175`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:45.366807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-53ab7283-2274-46d6-ae93-19bd057c5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:45.419566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:45.461267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1090/2185] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:45.466393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656ce9b-92c6-48c5-ad75-4afe094407c2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:45.554785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656ce9b-92c6-48c5-ad75-4afe094407c2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.561007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eb2c9-d90b-450d-a68e-f909b63d91f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:45.561738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb2c9-d90b-450d-a68e-f909b63d91f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.562113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb2c9-d90b-450d-a68e-f909b63d91f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.562463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb2c9-d90b-450d-a68e-f909b63d91f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.563181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0eb2c9-d90b-450d-a68e-f909b63d91f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:45.565205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0eb2c9-d90b-450d-a68e-f909b63d91f5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:45.619993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1096/2186] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:45 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:45.622710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab7283-2274-46d6-ae93-19bd057c5879 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:45.637014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab7283-2274-46d6-ae93-19bd057c5879 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.719658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663b813-204e-41e8-9baf-1ce67b6b6f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:45.720531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b813-204e-41e8-9baf-1ce67b6b6f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.720785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b813-204e-41e8-9baf-1ce67b6b6f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.721191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663b813-204e-41e8-9baf-1ce67b6b6f85 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.722138 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663b813-204e-41e8-9baf-1ce67b6b6f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:45.724501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663b813-204e-41e8-9baf-1ce67b6b6f85 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:45.776422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1091/2187] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:45 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:45.778615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eb2c9-d90b-450d-a68e-f909b63d91f5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:45.792419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eb2c9-d90b-450d-a68e-f909b63d91f5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.805853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50b9b-c701-403c-be43-ba0f5f464bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:45.806803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50b9b-c701-403c-be43-ba0f5f464bed admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.807349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50b9b-c701-403c-be43-ba0f5f464bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.807828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec50b9b-c701-403c-be43-ba0f5f464bed admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.808697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec50b9b-c701-403c-be43-ba0f5f464bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:45.811146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec50b9b-c701-403c-be43-ba0f5f464bed admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:45.842594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1097/2188] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:45.847258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663b813-204e-41e8-9baf-1ce67b6b6f85 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:45.858273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663b813-204e-41e8-9baf-1ce67b6b6f85 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.863914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3e658-60d2-4cb3-b2be-041f0cfc1576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:45.864573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e658-60d2-4cb3-b2be-041f0cfc1576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:45.864852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e658-60d2-4cb3-b2be-041f0cfc1576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:45.865124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e658-60d2-4cb3-b2be-041f0cfc1576 admin admin] PATH_INFO: `/v3/projects/b6b16d5e9cdb400d8d96b9e1a0771735/users/7c9e60a1ff2b4b11bcb3215be39d0f95/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:45.883817 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3e658-60d2-4cb3-b2be-041f0cfc1576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b16d5e9cdb400d8d96b9e1a0771735, user_id=7c9e60a1ff2b4b11bcb3215be39d0f95, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:45.889439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3e658-60d2-4cb3-b2be-041f0cfc1576 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:45.913021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1092/2189] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:45 2022] PUT /identity/v3/projects/b6b16d5e9cdb400d8d96b9e1a0771735/users/7c9e60a1ff2b4b11bcb3215be39d0f95/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:45.914252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50b9b-c701-403c-be43-ba0f5f464bed admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:45.927186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec50b9b-c701-403c-be43-ba0f5f464bed admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:45.954728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:46.183479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bff9b-fdca-44d5-89c9-ff122a2a7d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:46.184061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bff9b-fdca-44d5-89c9-ff122a2a7d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:46.184943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bff9b-fdca-44d5-89c9-ff122a2a7d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:46.185877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bff9b-fdca-44d5-89c9-ff122a2a7d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:46.187019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bff9b-fdca-44d5-89c9-ff122a2a7d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:46.188996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bff9b-fdca-44d5-89c9-ff122a2a7d20 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:46.227399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1098/2190] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:46.231656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3e658-60d2-4cb3-b2be-041f0cfc1576 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:46.247813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3e658-60d2-4cb3-b2be-041f0cfc1576 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:46.267537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:46.268236 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:46.268520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:46.268802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] PATH_INFO: `/v3/projects/b6b16d5e9cdb400d8d96b9e1a0771735/users/7c9e60a1ff2b4b11bcb3215be39d0f95/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:46.283787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b16d5e9cdb400d8d96b9e1a0771735, user_id=7c9e60a1ff2b4b11bcb3215be39d0f95, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:46.287124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:46.335869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed51ec-a4e1-4c9e-b6cb-bfde9202338c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:46.336291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed51ec-a4e1-4c9e-b6cb-bfde9202338c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:46.337209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed51ec-a4e1-4c9e-b6cb-bfde9202338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:46.340595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1093/2191] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:46 2022] PUT /identity/v3/projects/b6b16d5e9cdb400d8d96b9e1a0771735/users/7c9e60a1ff2b4b11bcb3215be39d0f95/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:46.419008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-53ed51ec-a4e1-4c9e-b6cb-bfde9202338c None None] MFA Rules not processed for user `7c9e60a1ff2b4b11bcb3215be39d0f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:46.421906 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-53ed51ec-a4e1-4c9e-b6cb-bfde9202338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:46.635266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:46.637335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:46.648287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1099/2192] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:46.770947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b60041-372b-4f6f-a4b9-a8d2cd816c85 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:46.776373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:46.777229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:46.779025 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:46.779526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:46.796441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:46.801833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:46.818559 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1094/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:46.916135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed51ec-a4e1-4c9e-b6cb-bfde9202338c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:46.931322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed51ec-a4e1-4c9e-b6cb-bfde9202338c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:46.953733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263a20d-ee6a-4fbc-b997-2c905b4dc704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:46.953733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a20d-ee6a-4fbc-b997-2c905b4dc704 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:46.953733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a20d-ee6a-4fbc-b997-2c905b4dc704 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:46.953733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a20d-ee6a-4fbc-b997-2c905b4dc704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:47.035104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263a20d-ee6a-4fbc-b997-2c905b4dc704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:47.036884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263a20d-ee6a-4fbc-b997-2c905b4dc704 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:47.049608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1100/2194] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:48.555665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:48.558200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:48.632302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:48.680641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04677d57-328c-4c40-aabd-1bd459387e83 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:48.696308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:48.717659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:48.717659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:48.717659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] PATH_INFO: `/v3/users/aa67fe0e31774829b370aede0e9786b7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:48.717659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa67fe0e31774829b370aede0e9786b7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:48.717659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:48.799011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa67fe0e31774829b370aede0e9786b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:48.809551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa67fe0e31774829b370aede0e9786b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:48.835212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa67fe0e31774829b370aede0e9786b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:48.835939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa67fe0e31774829b370aede0e9786b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:48.852892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa67fe0e31774829b370aede0e9786b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:48.865911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1095/2195] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:48 2022] DELETE /identity/v3/users/aa67fe0e31774829b370aede0e9786b7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:48.870477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef201-8901-4b25-9035-5cd8acbaeaa2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:48.871013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef201-8901-4b25-9035-5cd8acbaeaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:48.871013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef201-8901-4b25-9035-5cd8acbaeaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:48.915408 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-715ef201-8901-4b25-9035-5cd8acbaeaa2 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:48.916654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-715ef201-8901-4b25-9035-5cd8acbaeaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:48.988754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:49.035927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1101/2196] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:49.047134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:49.048765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:49.202304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff111d1-10f6-41a6-9b1c-2d4903edec94 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:49.206795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c64bb8-471d-4803-a7ab-e9bab8522e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:49.216840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c64bb8-471d-4803-a7ab-e9bab8522e32 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:49.217140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c64bb8-471d-4803-a7ab-e9bab8522e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:49.217435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c64bb8-471d-4803-a7ab-e9bab8522e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:49.239697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c64bb8-471d-4803-a7ab-e9bab8522e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:49.242111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c64bb8-471d-4803-a7ab-e9bab8522e32 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:49.271711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1096/2197] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:49.777706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ef201-8901-4b25-9035-5cd8acbaeaa2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:49.779242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-715ef201-8901-4b25-9035-5cd8acbaeaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:49.804413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ef201-8901-4b25-9035-5cd8acbaeaa2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:49.814339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:49.815419 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:49.816221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:49.816752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] PATH_INFO: `/v3/projects/9d6df00a262b41ee86a84650f0f12c4c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:49.818342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6df00a262b41ee86a84650f0f12c4c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:49.821711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:49.938986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6df00a262b41ee86a84650f0f12c4c', 'request_id': 'req-7502d90a-1813-40f2-b25f-4db0cd6985ea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:49.952526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6df00a262b41ee86a84650f0f12c4c', 'request_id': 'req-7502d90a-1813-40f2-b25f-4db0cd6985ea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:49.959329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6df00a262b41ee86a84650f0f12c4c', 'request_id': 'req-7502d90a-1813-40f2-b25f-4db0cd6985ea'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:49.971612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] The token cache is being invalidate because project 9d6df00a262b41ee86a84650f0f12c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:49.971901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:49.973070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7502d90a-1813-40f2-b25f-4db0cd6985ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:49.975006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1102/2198] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:49 2022] DELETE /identity/v3/projects/9d6df00a262b41ee86a84650f0f12c4c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:49.979003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c64bb8-471d-4803-a7ab-e9bab8522e32 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:49.989804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c64bb8-471d-4803-a7ab-e9bab8522e32 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:50.058687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:50.072066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:50.073133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:50.073442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:50.074813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] PATH_INFO: `/v3/users/d923b23500604bbdb1c8d2fe6a7d8812` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:50.077157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d923b23500604bbdb1c8d2fe6a7d8812)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:50.079605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:50.179355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd923b23500604bbdb1c8d2fe6a7d8812'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:50.196417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd923b23500604bbdb1c8d2fe6a7d8812'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:50.218777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd923b23500604bbdb1c8d2fe6a7d8812'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:50.220426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd923b23500604bbdb1c8d2fe6a7d8812'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:50.241613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd923b23500604bbdb1c8d2fe6a7d8812'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:50.256295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1097/2199] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:49 2022] DELETE /identity/v3/users/d923b23500604bbdb1c8d2fe6a7d8812 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:50.316154 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3500e6-05cf-4274-a07c-0161747975a4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:50.316665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3500e6-05cf-4274-a07c-0161747975a4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:50.317045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3500e6-05cf-4274-a07c-0161747975a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:50.377785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4e3500e6-05cf-4274-a07c-0161747975a4 None None] MFA Rules not processed for user `4afc7b71b36f424abab51cf03abba5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:50.379544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4e3500e6-05cf-4274-a07c-0161747975a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:50.505578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1103/2200] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:50.514538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:50.516060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:50.647735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f034b2-6f43-4a2e-a3f8-6db397ff5da7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:50.655086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5b3d-920d-4e5e-9926-ec8aa73ccf1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d637726e3142e6ba90fa201c764b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:50.655908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5b3d-920d-4e5e-9926-ec8aa73ccf1f service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:50.656154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5b3d-920d-4e5e-9926-ec8aa73ccf1f service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:50.656509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5b3d-920d-4e5e-9926-ec8aa73ccf1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:50.666351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3500e6-05cf-4274-a07c-0161747975a4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:50.668421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4e3500e6-05cf-4274-a07c-0161747975a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:50.676020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-848d5b3d-920d-4e5e-9926-ec8aa73ccf1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:50.771303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:50.774936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d5b3d-920d-4e5e-9926-ec8aa73ccf1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:50.777010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d5b3d-920d-4e5e-9926-ec8aa73ccf1f service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:50.781307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3500e6-05cf-4274-a07c-0161747975a4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:50.789337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:50.790422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:50.791032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1098/2201] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:50.804082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:50.804443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] PATH_INFO: `/v3/projects/a030051075d44a58b68bc1ecae1fc0e2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:50.810295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a030051075d44a58b68bc1ecae1fc0e2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:50.813495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:50.961241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a030051075d44a58b68bc1ecae1fc0e2', 'request_id': 'req-94fe7614-f030-446f-97de-5a1ec233a0a2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:50.976541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a030051075d44a58b68bc1ecae1fc0e2', 'request_id': 'req-94fe7614-f030-446f-97de-5a1ec233a0a2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:50.998424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a030051075d44a58b68bc1ecae1fc0e2', 'request_id': 'req-94fe7614-f030-446f-97de-5a1ec233a0a2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:51.032895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] The token cache is being invalidate because project a030051075d44a58b68bc1ecae1fc0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:51.033101 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:51.040455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94fe7614-f030-446f-97de-5a1ec233a0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:51.046267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1104/2202] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:50 2022] DELETE /identity/v3/projects/a030051075d44a58b68bc1ecae1fc0e2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:51.052014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd3de-f434-4816-91be-46b05baf7968 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.052515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd3de-f434-4816-91be-46b05baf7968 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.052599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd3de-f434-4816-91be-46b05baf7968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.057457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8060ae8-2a4b-40b7-8673-5cbfb99b9e6b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.058070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8060ae8-2a4b-40b7-8673-5cbfb99b9e6b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.058627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8060ae8-2a4b-40b7-8673-5cbfb99b9e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.089264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e8060ae8-2a4b-40b7-8673-5cbfb99b9e6b None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:51.091623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e8060ae8-2a4b-40b7-8673-5cbfb99b9e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:51.098459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e93dd3de-f434-4816-91be-46b05baf7968 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:51.100530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e93dd3de-f434-4816-91be-46b05baf7968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:51.119258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:51.194125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1105/2203] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:51.222851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1099/2204] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:51.230493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c124248-27c1-46b4-9687-c53a3675d7cc None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.230591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c124248-27c1-46b4-9687-c53a3675d7cc None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.230960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c124248-27c1-46b4-9687-c53a3675d7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.266150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3c124248-27c1-46b4-9687-c53a3675d7cc None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:51.267523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3c124248-27c1-46b4-9687-c53a3675d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:51.284568 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1106/2205] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:51.288811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd3de-f434-4816-91be-46b05baf7968 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:51.297002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c124248-27c1-46b4-9687-c53a3675d7cc None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:51.299112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3c124248-27c1-46b4-9687-c53a3675d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:51.300635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd3de-f434-4816-91be-46b05baf7968 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:51.305918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:51.306603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.306953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.307252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.307878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:51.308192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:51.309880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:51.329598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1100/2206] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:51.335905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:51.353787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a457b0-4b8b-44bf-bf44-7824b29a579b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:51.362220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab985760-ce2a-4dfb-8c66-d67a21aa17b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:51.363069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab985760-ce2a-4dfb-8c66-d67a21aa17b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.363359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab985760-ce2a-4dfb-8c66-d67a21aa17b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.363525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab985760-ce2a-4dfb-8c66-d67a21aa17b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.364336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab985760-ce2a-4dfb-8c66-d67a21aa17b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:51.370067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab985760-ce2a-4dfb-8c66-d67a21aa17b1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:51.415134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c124248-27c1-46b4-9687-c53a3675d7cc None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:51.421840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79940b46-91a2-4ea4-88af-01f48f5103a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:51.422622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940b46-91a2-4ea4-88af-01f48f5103a0 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.422975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940b46-91a2-4ea4-88af-01f48f5103a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.423249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940b46-91a2-4ea4-88af-01f48f5103a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.434069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79940b46-91a2-4ea4-88af-01f48f5103a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:51.436227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79940b46-91a2-4ea4-88af-01f48f5103a0 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:51.438972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1101/2207] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:51 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:51.447369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab985760-ce2a-4dfb-8c66-d67a21aa17b1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:51.453060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1107/2208] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:14:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 01:14:51.619665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab985760-ce2a-4dfb-8c66-d67a21aa17b1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:51.629274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:51.630241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.630522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.630796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.631697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:51.639491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:51.684846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1102/2209] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:51 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:51.689249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79940b46-91a2-4ea4-88af-01f48f5103a0 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:51.717375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79940b46-91a2-4ea4-88af-01f48f5103a0 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:51.723092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08231-e1dc-4ccb-902b-27955176faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:51.723843 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:51.726388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08231-e1dc-4ccb-902b-27955176faa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.726671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:51.728150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08231-e1dc-4ccb-902b-27955176faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.728150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08231-e1dc-4ccb-902b-27955176faa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.729500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08231-e1dc-4ccb-902b-27955176faa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:51.732212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf08231-e1dc-4ccb-902b-27955176faa3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:51.753085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1108/2210] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:51.757837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08231-e1dc-4ccb-902b-27955176faa3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:51.760399 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b133425-eb7e-4d66-84fc-c40d8d406240 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:51.766082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:51.770400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:51.771442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.772077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.772352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] PATH_INFO: `/v3/users/69bde2a239b546efa257a19f498d9175` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.774781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bde2a239b546efa257a19f498d9175)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:51.777603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:51.778691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08231-e1dc-4ccb-902b-27955176faa3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:51.786493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26568d-575c-44d3-96d0-76c3bdcb6b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:51.787727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26568d-575c-44d3-96d0-76c3bdcb6b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.787727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26568d-575c-44d3-96d0-76c3bdcb6b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.789789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26568d-575c-44d3-96d0-76c3bdcb6b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.793384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26568d-575c-44d3-96d0-76c3bdcb6b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:51.795160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26568d-575c-44d3-96d0-76c3bdcb6b0b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:51.809476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1109/2211] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:51.812201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26568d-575c-44d3-96d0-76c3bdcb6b0b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:51.826440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26568d-575c-44d3-96d0-76c3bdcb6b0b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:51.844321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94cfc6-c4bd-4554-b4d0-17338d00a704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:51.845108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94cfc6-c4bd-4554-b4d0-17338d00a704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.845661 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94cfc6-c4bd-4554-b4d0-17338d00a704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.845890 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94cfc6-c4bd-4554-b4d0-17338d00a704 admin admin] PATH_INFO: `/v3/projects/7c12887b97ed4177aed54edf24f98aac/users/8660e07ea183412a858badc785b14e9c/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.863000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bde2a239b546efa257a19f498d9175'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:51.872494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bde2a239b546efa257a19f498d9175'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:51.874238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94cfc6-c4bd-4554-b4d0-17338d00a704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c12887b97ed4177aed54edf24f98aac, user_id=8660e07ea183412a858badc785b14e9c, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:51.877558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94cfc6-c4bd-4554-b4d0-17338d00a704 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:51.884141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:51.898771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1110/2212] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:51 2022] PUT /identity/v3/projects/7c12887b97ed4177aed54edf24f98aac/users/8660e07ea183412a858badc785b14e9c/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:51.899721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bde2a239b546efa257a19f498d9175'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:51.900530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bde2a239b546efa257a19f498d9175'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:51.909827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a94c2f-efaa-4043-9435-34255758380b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.910173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a94c2f-efaa-4043-9435-34255758380b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.910634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a94c2f-efaa-4043-9435-34255758380b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.914053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2cfa95af-4faa-47c3-bce0-9a35f7efa794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bde2a239b546efa257a19f498d9175'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:51.922780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1103/2213] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:51 2022] DELETE /identity/v3/users/69bde2a239b546efa257a19f498d9175 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:51.929651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2f51-b67a-4ac7-a81b-08cb75041711 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:51.931936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2f51-b67a-4ac7-a81b-08cb75041711 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:51.931936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2f51-b67a-4ac7-a81b-08cb75041711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:51.997032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e4a94c2f-efaa-4043-9435-34255758380b None None] MFA Rules not processed for user `8660e07ea183412a858badc785b14e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:51.998567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e4a94c2f-efaa-4043-9435-34255758380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:52.000180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-027c2f51-b67a-4ac7-a81b-08cb75041711 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:52.001388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-027c2f51-b67a-4ac7-a81b-08cb75041711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:52.106928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1111/2214] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:52.128509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a94c2f-efaa-4043-9435-34255758380b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:52.138342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1104/2215] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:52.140741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e4a94c2f-efaa-4043-9435-34255758380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:52.150351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2f51-b67a-4ac7-a81b-08cb75041711 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:52.166874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a94c2f-efaa-4043-9435-34255758380b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:52.167153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-027c2f51-b67a-4ac7-a81b-08cb75041711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:52.185122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1170d74-cfd5-45cc-85a6-f43bcfef224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:52.186232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1170d74-cfd5-45cc-85a6-f43bcfef224f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:52.186676 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1170d74-cfd5-45cc-85a6-f43bcfef224f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:52.187096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1170d74-cfd5-45cc-85a6-f43bcfef224f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:52.188022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1170d74-cfd5-45cc-85a6-f43bcfef224f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:52.191579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1170d74-cfd5-45cc-85a6-f43bcfef224f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:52.269739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1112/2216] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:52 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:52.274181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1170d74-cfd5-45cc-85a6-f43bcfef224f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:52.392973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2f51-b67a-4ac7-a81b-08cb75041711 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:52.458688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1170d74-cfd5-45cc-85a6-f43bcfef224f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:52.470477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5a83-c0d9-42de-bf84-352656e71e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:52.471259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5a83-c0d9-42de-bf84-352656e71e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:52.471639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5a83-c0d9-42de-bf84-352656e71e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:52.472033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5a83-c0d9-42de-bf84-352656e71e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:52.475567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f5a83-c0d9-42de-bf84-352656e71e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:52.477858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f5a83-c0d9-42de-bf84-352656e71e37 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:52.531724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1113/2217] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:52 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:52.533249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5a83-c0d9-42de-bf84-352656e71e37 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:52.540262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100be8-e885-4fd8-bb51-2087e99facbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:52.540893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100be8-e885-4fd8-bb51-2087e99facbc service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:52.541176 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100be8-e885-4fd8-bb51-2087e99facbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:52.541488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100be8-e885-4fd8-bb51-2087e99facbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:52.552972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5a83-c0d9-42de-bf84-352656e71e37 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:52.561333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81bb60-6b65-44e1-9bdd-38d65d62d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:52.562246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bb60-6b65-44e1-9bdd-38d65d62d445 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:52.562694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bb60-6b65-44e1-9bdd-38d65d62d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:52.563278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bb60-6b65-44e1-9bdd-38d65d62d445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:52.564148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81bb60-6b65-44e1-9bdd-38d65d62d445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:52.566256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81bb60-6b65-44e1-9bdd-38d65d62d445 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:52.587748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d100be8-e885-4fd8-bb51-2087e99facbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:52.589537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d100be8-e885-4fd8-bb51-2087e99facbc service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:52.600766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1114/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:52.607295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81bb60-6b65-44e1-9bdd-38d65d62d445 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:52.610688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1105/2219] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:14:52.623578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81bb60-6b65-44e1-9bdd-38d65d62d445 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:52.629389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9b103-b51b-480f-8ebf-25cf37971c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:52.630332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b103-b51b-480f-8ebf-25cf37971c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:52.630793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b103-b51b-480f-8ebf-25cf37971c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:52.638584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b103-b51b-480f-8ebf-25cf37971c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:52.639766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9b103-b51b-480f-8ebf-25cf37971c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:52.641618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9b103-b51b-480f-8ebf-25cf37971c5f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:52.662153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1115/2220] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:52.665856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100be8-e885-4fd8-bb51-2087e99facbc service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:52.699788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100be8-e885-4fd8-bb51-2087e99facbc service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:52.715458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670d3f-1950-47f3-b5b7-88bbe34d6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:52.716600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670d3f-1950-47f3-b5b7-88bbe34d6db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:52.716891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670d3f-1950-47f3-b5b7-88bbe34d6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:52.717167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670d3f-1950-47f3-b5b7-88bbe34d6db8 admin admin] PATH_INFO: `/v3/projects/82a0b3f986584426a7f8fa2bf6270755/users/958adc4b05564eedaf42f3b9fae18c60/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:52.740124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27670d3f-1950-47f3-b5b7-88bbe34d6db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a0b3f986584426a7f8fa2bf6270755, user_id=958adc4b05564eedaf42f3b9fae18c60, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:52.745604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27670d3f-1950-47f3-b5b7-88bbe34d6db8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:52.778128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1106/2221] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:52 2022] PUT /identity/v3/projects/82a0b3f986584426a7f8fa2bf6270755/users/958adc4b05564eedaf42f3b9fae18c60/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:52.790443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44181bc5-fb24-4c98-b43c-b33ebda9d5a4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:52.790734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44181bc5-fb24-4c98-b43c-b33ebda9d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:52.790998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44181bc5-fb24-4c98-b43c-b33ebda9d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:52.799893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:52.841611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-44181bc5-fb24-4c98-b43c-b33ebda9d5a4 None None] MFA Rules not processed for user `958adc4b05564eedaf42f3b9fae18c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:52.843031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44181bc5-fb24-4c98-b43c-b33ebda9d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:52.941327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1116/2222] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:52.942099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670d3f-1950-47f3-b5b7-88bbe34d6db8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:52.977936 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:53.041792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670d3f-1950-47f3-b5b7-88bbe34d6db8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:53.055908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:53.056709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:53.056991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:53.057252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:53.058171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:53.060672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:53.119188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1107/2223] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:52 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:53.123483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44181bc5-fb24-4c98-b43c-b33ebda9d5a4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:53.140397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44181bc5-fb24-4c98-b43c-b33ebda9d5a4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:53.188769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:53.191336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:53.230920 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0efa51-3f98-42db-bf9d-4692a5ec5f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:53.231968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efa51-3f98-42db-bf9d-4692a5ec5f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:53.232797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efa51-3f98-42db-bf9d-4692a5ec5f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:53.233437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efa51-3f98-42db-bf9d-4692a5ec5f52 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:53.248708 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0efa51-3f98-42db-bf9d-4692a5ec5f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:53.252207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0efa51-3f98-42db-bf9d-4692a5ec5f52 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:53.287192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897d8cc-b303-44ed-99a8-3445c51622ec admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:53.287740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1117/2224] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:53 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:53.292565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0efa51-3f98-42db-bf9d-4692a5ec5f52 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:53.294278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:53.295114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:53.295397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:53.295673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] PATH_INFO: `/v3/projects/4eb7e5bef6ee4d4d8ab489519fe60d71` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:53.296841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb7e5bef6ee4d4d8ab489519fe60d71)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:53.298953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:53.314597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0efa51-3f98-42db-bf9d-4692a5ec5f52 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:53.319513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37c955-43c3-443f-8787-023a40ec5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:53.321621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37c955-43c3-443f-8787-023a40ec5f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:53.322009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37c955-43c3-443f-8787-023a40ec5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:53.322383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37c955-43c3-443f-8787-023a40ec5f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:53.323139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37c955-43c3-443f-8787-023a40ec5f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:53.324840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37c955-43c3-443f-8787-023a40ec5f0c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:53.343026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1118/2225] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:53.344545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37c955-43c3-443f-8787-023a40ec5f0c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:53.365133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37c955-43c3-443f-8787-023a40ec5f0c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:53.380337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb7e5bef6ee4d4d8ab489519fe60d71', 'request_id': 'req-22a3eabf-d480-4601-84a9-e4e7294d32d6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.395816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb7e5bef6ee4d4d8ab489519fe60d71', 'request_id': 'req-22a3eabf-d480-4601-84a9-e4e7294d32d6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.407213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb7e5bef6ee4d4d8ab489519fe60d71', 'request_id': 'req-22a3eabf-d480-4601-84a9-e4e7294d32d6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.529667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] The token cache is being invalidate because project 4eb7e5bef6ee4d4d8ab489519fe60d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:53.530118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.531234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.533067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1108/2226] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:53 2022] DELETE /identity/v3/projects/4eb7e5bef6ee4d4d8ab489519fe60d71 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:53.537359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:53.538800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:53.561577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:53.562273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:53.562552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:53.562825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] PATH_INFO: `/v3/projects/9a4fe5dbdf7649acb695a4a6b5d8bc4d/users/955a49ce192c444ab6bbaf9e9b1ff898/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:53.584305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:53.609004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4fe5dbdf7649acb695a4a6b5d8bc4d, user_id=955a49ce192c444ab6bbaf9e9b1ff898, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:53.614391 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:53.625591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:53.645266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3eabf-d480-4601-84a9-e4e7294d32d6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:53.659114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1119/2227] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:53 2022] PUT /identity/v3/projects/9a4fe5dbdf7649acb695a4a6b5d8bc4d/users/955a49ce192c444ab6bbaf9e9b1ff898/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:53.662406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:53.673794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:53.732131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:53.733377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:53.734095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:53.734611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] PATH_INFO: `/v3/users/7c9e60a1ff2b4b11bcb3215be39d0f95` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:53.744072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9e60a1ff2b4b11bcb3215be39d0f95)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:53.746568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:53.827918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9e60a1ff2b4b11bcb3215be39d0f95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.837314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9e60a1ff2b4b11bcb3215be39d0f95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.838677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bebf3-e01d-4b24-bf6c-f8480b3b2b3e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:53.845572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:53.846337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:53.846729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:53.847302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:53.848509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:53.850290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:53.855955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9e60a1ff2b4b11bcb3215be39d0f95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.856893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9e60a1ff2b4b11bcb3215be39d0f95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.861828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1120/2228] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:53.866900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:53.870063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9c7086f5-f6e0-4698-bff5-bb9ddf19e188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9e60a1ff2b4b11bcb3215be39d0f95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:53.873030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:53.877504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1109/2229] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:14:53 2022] DELETE /identity/v3/users/7c9e60a1ff2b4b11bcb3215be39d0f95 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:53.891644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ddb63-0315-4278-ba4a-7077c502a4e4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:53.978322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:53.980068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:53.980543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:53.980986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] PATH_INFO: `/v3/projects/9a4fe5dbdf7649acb695a4a6b5d8bc4d/users/955a49ce192c444ab6bbaf9e9b1ff898/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:53.983349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4fe5dbdf7649acb695a4a6b5d8bc4d, user_id=955a49ce192c444ab6bbaf9e9b1ff898, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:53.986514 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:54.031974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1121/2230] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:53 2022] PUT /identity/v3/projects/9a4fe5dbdf7649acb695a4a6b5d8bc4d/users/955a49ce192c444ab6bbaf9e9b1ff898/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:54.043617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f415a8-9101-49e1-94da-fed1cadcba0a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:54.044145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f415a8-9101-49e1-94da-fed1cadcba0a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:54.044580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f415a8-9101-49e1-94da-fed1cadcba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:54.099817 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c9f415a8-9101-49e1-94da-fed1cadcba0a None None] MFA Rules not processed for user `955a49ce192c444ab6bbaf9e9b1ff898`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:54.103737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c9f415a8-9101-49e1-94da-fed1cadcba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:54.183435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:54.223987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1110/2231] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:54.235497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:54.237247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:54.333139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f415a8-9101-49e1-94da-fed1cadcba0a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:54.334964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c9f415a8-9101-49e1-94da-fed1cadcba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:54.352315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45606e12-b421-46db-8dfc-f4441d366d9d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:54.363031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d4889-e966-4a73-8e24-d7dff5bd4375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:54.364513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4889-e966-4a73-8e24-d7dff5bd4375 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:54.365929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4889-e966-4a73-8e24-d7dff5bd4375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:54.366354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4889-e966-4a73-8e24-d7dff5bd4375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:54.384172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d4889-e966-4a73-8e24-d7dff5bd4375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:54.394342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d4889-e966-4a73-8e24-d7dff5bd4375 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:54.414846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1122/2232] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:54.453363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f415a8-9101-49e1-94da-fed1cadcba0a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:54.481451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:54.482111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:54.487434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:54.487773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] PATH_INFO: `/v3/projects/b6b16d5e9cdb400d8d96b9e1a0771735` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:54.489229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b16d5e9cdb400d8d96b9e1a0771735)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:54.491970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:54.576890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b16d5e9cdb400d8d96b9e1a0771735', 'request_id': 'req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:54.589607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b16d5e9cdb400d8d96b9e1a0771735', 'request_id': 'req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:54.596925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b16d5e9cdb400d8d96b9e1a0771735', 'request_id': 'req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:54.616053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] The token cache is being invalidate because project b6b16d5e9cdb400d8d96b9e1a0771735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:14:54.616357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:54.617087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7d2b2a9-7638-4bf8-87cf-5d83dc85c8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:14:54.624037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1111/2233] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:14:54 2022] DELETE /identity/v3/projects/b6b16d5e9cdb400d8d96b9e1a0771735 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:54.626135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5a6a-e551-49a5-b6aa-719336c186bd None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:54.626527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5a6a-e551-49a5-b6aa-719336c186bd None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:54.626874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5a6a-e551-49a5-b6aa-719336c186bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:54.655116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5d9b5a6a-e551-49a5-b6aa-719336c186bd None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:54.656591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5d9b5a6a-e551-49a5-b6aa-719336c186bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:54.700619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:54.785185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1123/2234] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:14:54.795265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7a5d-2703-4bbb-bc75-47522bd0795c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:54.795742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7a5d-2703-4bbb-bc75-47522bd0795c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:54.796188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7a5d-2703-4bbb-bc75-47522bd0795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:54.824363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-75cf7a5d-2703-4bbb-bc75-47522bd0795c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:54.825992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-75cf7a5d-2703-4bbb-bc75-47522bd0795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:54.841147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1112/2235] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:54.845297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b5a6a-e551-49a5-b6aa-719336c186bd None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:54.859599 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b5a6a-e551-49a5-b6aa-719336c186bd None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:54.867560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:54.871438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:54.871979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:54.872407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:54.873390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:14:54.873891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:54.876072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:54.895833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1124/2236] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:14:54.899953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf7a5d-2703-4bbb-bc75-47522bd0795c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:54.919433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf7a5d-2703-4bbb-bc75-47522bd0795c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:54.930218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10a13-8f11-4c18-8ae1-759d70d0253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:54.931286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10a13-8f11-4c18-8ae1-759d70d0253a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:54.931751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10a13-8f11-4c18-8ae1-759d70d0253a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:54.932397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10a13-8f11-4c18-8ae1-759d70d0253a admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:54.933789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa10a13-8f11-4c18-8ae1-759d70d0253a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:54.936812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa10a13-8f11-4c18-8ae1-759d70d0253a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:54.984566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1113/2237] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:54 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:54.989448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:55.003161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fda907-1ce4-4db4-bd04-7ea339e6eee5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:55.141912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aacd0-e5f8-4e9f-8f6e-748d354a0d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:55.142737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aacd0-e5f8-4e9f-8f6e-748d354a0d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:55.143030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aacd0-e5f8-4e9f-8f6e-748d354a0d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:55.143311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aacd0-e5f8-4e9f-8f6e-748d354a0d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:55.143956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aacd0-e5f8-4e9f-8f6e-748d354a0d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:55.145926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aacd0-e5f8-4e9f-8f6e-748d354a0d5b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:55.184049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1125/2238] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:54 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:55.188412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10a13-8f11-4c18-8ae1-759d70d0253a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:55.199506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10a13-8f11-4c18-8ae1-759d70d0253a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:55.204911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f105b05-b2be-4500-963c-0f86a89f22aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:55.205685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105b05-b2be-4500-963c-0f86a89f22aa admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:55.206069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105b05-b2be-4500-963c-0f86a89f22aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:55.206341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105b05-b2be-4500-963c-0f86a89f22aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:55.207021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f105b05-b2be-4500-963c-0f86a89f22aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:55.208968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f105b05-b2be-4500-963c-0f86a89f22aa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:55.223856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1114/2239] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:55.224712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aacd0-e5f8-4e9f-8f6e-748d354a0d5b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:55.240000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aacd0-e5f8-4e9f-8f6e-748d354a0d5b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:55.248301 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:55.248924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:55.249200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:55.249510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:55.250161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:55.251749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:55.277236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1126/2240] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:14:55.284928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f105b05-b2be-4500-963c-0f86a89f22aa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:55.296179 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f105b05-b2be-4500-963c-0f86a89f22aa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:55.316414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:55.318933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:55.319403 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ef62a-d557-4632-9d27-f428d0989ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:55.320160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef62a-d557-4632-9d27-f428d0989ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:55.320583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef62a-d557-4632-9d27-f428d0989ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:55.320955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef62a-d557-4632-9d27-f428d0989ec1 admin admin] PATH_INFO: `/v3/projects/c8bd91da266245358ba6f2fc48e75607/users/540fcd4367ac4969afa88f9fb83042df/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:55.346944 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ef62a-d557-4632-9d27-f428d0989ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bd91da266245358ba6f2fc48e75607, user_id=540fcd4367ac4969afa88f9fb83042df, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:55.351228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ef62a-d557-4632-9d27-f428d0989ec1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:55.366664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1115/2241] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:55 2022] PUT /identity/v3/projects/c8bd91da266245358ba6f2fc48e75607/users/540fcd4367ac4969afa88f9fb83042df/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:55.380967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d71db-b102-48fa-9707-0c0081f88a06 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:55.381528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d71db-b102-48fa-9707-0c0081f88a06 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:55.381884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d71db-b102-48fa-9707-0c0081f88a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:55.401495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:55.434691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b2170-bcc0-4371-88c2-48ae5bf32a31 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:55.439169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ca1d71db-b102-48fa-9707-0c0081f88a06 None None] MFA Rules not processed for user `540fcd4367ac4969afa88f9fb83042df`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:55.440642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ca1d71db-b102-48fa-9707-0c0081f88a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:55.519131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:55.524922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:55.525595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:55.526467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:55.527766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:55.530686 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:55.546527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1116/2242] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:14:55.551923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d71db-b102-48fa-9707-0c0081f88a06 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:55.627484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:55.629201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:55.645309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1127/2243] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:14:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:14:55.663375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d71db-b102-48fa-9707-0c0081f88a06 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:55.669223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfdd28-47e8-46b6-8abf-98cd2e3746dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:55.672358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfdd28-47e8-46b6-8abf-98cd2e3746dd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:55.672709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfdd28-47e8-46b6-8abf-98cd2e3746dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:55.673073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfdd28-47e8-46b6-8abf-98cd2e3746dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:55.674003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfdd28-47e8-46b6-8abf-98cd2e3746dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:55.676408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfdd28-47e8-46b6-8abf-98cd2e3746dd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:55.719207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1117/2244] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:14:55 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:55.720654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:55.756270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46f018-2fcc-491b-9bbe-b9d5af3642b1 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:55.909251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2db9f9-ea24-4334-bf5f-cf5e6fcd23e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:55.912389 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db9f9-ea24-4334-bf5f-cf5e6fcd23e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:55.913129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db9f9-ea24-4334-bf5f-cf5e6fcd23e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:55.913701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db9f9-ea24-4334-bf5f-cf5e6fcd23e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:55.914490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2db9f9-ea24-4334-bf5f-cf5e6fcd23e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:55.919313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2db9f9-ea24-4334-bf5f-cf5e6fcd23e1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:55.986600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1128/2245] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:14:55 2022] POST /identity/v3/users => generated 295 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:14:55.989566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfdd28-47e8-46b6-8abf-98cd2e3746dd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:56.009846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfdd28-47e8-46b6-8abf-98cd2e3746dd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:56.015668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf061be-5aa8-4ad1-a978-901bf67be3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:56.016418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf061be-5aa8-4ad1-a978-901bf67be3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:56.017058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf061be-5aa8-4ad1-a978-901bf67be3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:56.017058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf061be-5aa8-4ad1-a978-901bf67be3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:56.017915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf061be-5aa8-4ad1-a978-901bf67be3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:56.019632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf061be-5aa8-4ad1-a978-901bf67be3d6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:56.041683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1118/2246] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:56.042646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2db9f9-ea24-4334-bf5f-cf5e6fcd23e1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:56.053790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2db9f9-ea24-4334-bf5f-cf5e6fcd23e1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:56.066901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ff1d-e230-4bc6-8fe6-6ebcf56d4be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:56.066901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ff1d-e230-4bc6-8fe6-6ebcf56d4be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:56.066901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ff1d-e230-4bc6-8fe6-6ebcf56d4be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:56.066901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ff1d-e230-4bc6-8fe6-6ebcf56d4be0 admin admin] PATH_INFO: `/v3/projects/25451d02678e4acab202d3d6be9aa599/users/0bb9f96118884fd9aba9663937fde0b8/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:56.089430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4ff1d-e230-4bc6-8fe6-6ebcf56d4be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25451d02678e4acab202d3d6be9aa599, user_id=0bb9f96118884fd9aba9663937fde0b8, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:56.092270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4ff1d-e230-4bc6-8fe6-6ebcf56d4be0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:56.150973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1129/2247] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:56 2022] PUT /identity/v3/projects/25451d02678e4acab202d3d6be9aa599/users/0bb9f96118884fd9aba9663937fde0b8/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:14:56.151744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf061be-5aa8-4ad1-a978-901bf67be3d6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:56.190963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf061be-5aa8-4ad1-a978-901bf67be3d6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:56.329996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5a1c1-f1d8-4e61-ba22-077b1624a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:56.330724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a1c1-f1d8-4e61-ba22-077b1624a068 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:56.330988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a1c1-f1d8-4e61-ba22-077b1624a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:56.331409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a1c1-f1d8-4e61-ba22-077b1624a068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:56.332068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5a1c1-f1d8-4e61-ba22-077b1624a068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:56.333929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5a1c1-f1d8-4e61-ba22-077b1624a068 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:56.345857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1119/2248] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:14:56.350181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ff1d-e230-4bc6-8fe6-6ebcf56d4be0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:14:56.366479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ff1d-e230-4bc6-8fe6-6ebcf56d4be0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:14:56.372489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:14:56.373163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:56.373471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:56.373751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] PATH_INFO: `/v3/projects/25451d02678e4acab202d3d6be9aa599/users/0bb9f96118884fd9aba9663937fde0b8/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:56.375904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25451d02678e4acab202d3d6be9aa599, user_id=0bb9f96118884fd9aba9663937fde0b8, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:14:56.379016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:14:56.401902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1130/2249] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:14:56 2022] PUT /identity/v3/projects/25451d02678e4acab202d3d6be9aa599/users/0bb9f96118884fd9aba9663937fde0b8/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:14:56.406290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a59f6-356a-4cec-a0f1-8aa9a28b7154 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:14:56.406793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a59f6-356a-4cec-a0f1-8aa9a28b7154 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:14:56.407074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a59f6-356a-4cec-a0f1-8aa9a28b7154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:14:56.415842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:56.444831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-843a59f6-356a-4cec-a0f1-8aa9a28b7154 None None] MFA Rules not processed for user `0bb9f96118884fd9aba9663937fde0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:14:56.446158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-843a59f6-356a-4cec-a0f1-8aa9a28b7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:14:56.565854 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1120/2250] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:14:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:00.310640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:00.312366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:00.396804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff13a5-469a-4263-a438-f635ab14423b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:00.402559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:00.403263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:00.403712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:00.403999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:00.406059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:00.418992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:00.493214 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:00.494814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:00.510737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1131/2251] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:02.931526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a59f6-356a-4cec-a0f1-8aa9a28b7154 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:02.932989 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-843a59f6-356a-4cec-a0f1-8aa9a28b7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:02.951119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:02.959872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20360-f223-4af2-a653-0566ed49e09d service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:02.968709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e4888-62a2-4f1b-a37b-9ca4f61abae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:02.969324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e4888-62a2-4f1b-a37b-9ca4f61abae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:02.969637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e4888-62a2-4f1b-a37b-9ca4f61abae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:02.969918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e4888-62a2-4f1b-a37b-9ca4f61abae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:02.981440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e4888-62a2-4f1b-a37b-9ca4f61abae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:02.983457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e4888-62a2-4f1b-a37b-9ca4f61abae3 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:02.997193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1132/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:15:03.013130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a59f6-356a-4cec-a0f1-8aa9a28b7154 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:03.018039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:03.021619 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:03.021917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:03.022201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] PATH_INFO: `/v3/users/8660e07ea183412a858badc785b14e9c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:03.023673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8660e07ea183412a858badc785b14e9c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:03.025693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:03.089165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8660e07ea183412a858badc785b14e9c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:03.097833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8660e07ea183412a858badc785b14e9c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:03.107300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bbde-5f2f-4936-bb59-ed0a7e818a29 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:03.107609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bbde-5f2f-4936-bb59-ed0a7e818a29 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:03.107858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bbde-5f2f-4936-bb59-ed0a7e818a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:03.113872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8660e07ea183412a858badc785b14e9c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:03.114594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8660e07ea183412a858badc785b14e9c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:03.129317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b92f671f-0ff6-4065-a09b-7f1cab26e50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8660e07ea183412a858badc785b14e9c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:03.130310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-be41bbde-5f2f-4936-bb59-ed0a7e818a29 None None] MFA Rules not processed for user `96d57472de274ccabb02dc210283b4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:03.133035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-be41bbde-5f2f-4936-bb59-ed0a7e818a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:03.146252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1121/2253] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:02 2022] DELETE /identity/v3/users/8660e07ea183412a858badc785b14e9c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:03.151458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946c41-f559-428c-ac6d-8c74c1c6940f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:03.151750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946c41-f559-428c-ac6d-8c74c1c6940f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:03.152023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946c41-f559-428c-ac6d-8c74c1c6940f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:03.172536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-68946c41-f559-428c-ac6d-8c74c1c6940f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:03.173885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-68946c41-f559-428c-ac6d-8c74c1c6940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:03.178569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:03.209590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1133/2254] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:03.248379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1122/2255] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:03.259327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41bbde-5f2f-4936-bb59-ed0a7e818a29 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:03.261680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-be41bbde-5f2f-4936-bb59-ed0a7e818a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:03.340221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41bbde-5f2f-4936-bb59-ed0a7e818a29 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:03.390691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68946c41-f559-428c-ac6d-8c74c1c6940f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:03.393463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-68946c41-f559-428c-ac6d-8c74c1c6940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:03.420641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9ff6c-c78f-41f5-a518-4bf15d0378f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:03.421703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9ff6c-c78f-41f5-a518-4bf15d0378f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:03.423749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9ff6c-c78f-41f5-a518-4bf15d0378f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:03.424411 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9ff6c-c78f-41f5-a518-4bf15d0378f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:03.440633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9ff6c-c78f-41f5-a518-4bf15d0378f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:03.443037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9ff6c-c78f-41f5-a518-4bf15d0378f8 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:03.451375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:03.465588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1134/2256] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:15:03.480463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68946c41-f559-428c-ac6d-8c74c1c6940f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:03.486352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bb9f96118884fd9aba9663937fde0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25451d02678e4acab202d3d6be9aa599', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:03.487051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:03.487413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:03.487786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:03.488523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:03.488909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:03.490653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:03.516725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1123/2257] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:15:03.520835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9ff6c-c78f-41f5-a518-4bf15d0378f8 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:03.541181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9ff6c-c78f-41f5-a518-4bf15d0378f8 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:03.554914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bb9f96118884fd9aba9663937fde0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25451d02678e4acab202d3d6be9aa599', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:03.555537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:03.556501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:03.556787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:03.557517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:03.559412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:03.594533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1135/2258] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:03 2022] POST /identity/v3/projects => generated 355 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:03.598824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:03.613933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27a8f-1069-4bfb-8cd2-759305ed3765 tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:03.734927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bb9f96118884fd9aba9663937fde0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25451d02678e4acab202d3d6be9aa599', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:03.735756 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:03.736136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:03.736527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:03.737582 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:03.737962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:03.739713 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:03.758876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1124/2259] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:15:03.800470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:03.802574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:03.838755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:03.852456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f9b00-b926-4794-9182-02bfba019d4f tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:03.861233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bb9f96118884fd9aba9663937fde0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25451d02678e4acab202d3d6be9aa599', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:03.861966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:03.862251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:03.862522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] PATH_INFO: `/v3/projects/a83a02c5036842a0bc94f32e2f6e0722` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:03.863742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a83a02c5036842a0bc94f32e2f6e0722)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:03.866650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:03.926539 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:03.952975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83a02c5036842a0bc94f32e2f6e0722', 'request_id': 'req-d04129ab-45a4-49c7-9844-8476024f6ddd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:03.966773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83a02c5036842a0bc94f32e2f6e0722', 'request_id': 'req-d04129ab-45a4-49c7-9844-8476024f6ddd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:03.977762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d655e-22f2-44ec-8b14-992b2f9bcb9b tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:03.978948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83a02c5036842a0bc94f32e2f6e0722', 'request_id': 'req-d04129ab-45a4-49c7-9844-8476024f6ddd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.002040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] The token cache is being invalidate because project a83a02c5036842a0bc94f32e2f6e0722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:04.002353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.004133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.008635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1125/2260] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:03 2022] DELETE /identity/v3/projects/a83a02c5036842a0bc94f32e2f6e0722 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:04.078291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:04.079462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:04.079757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:04.080847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] PATH_INFO: `/v3/projects/7c12887b97ed4177aed54edf24f98aac` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:04.082081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c12887b97ed4177aed54edf24f98aac)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:04.085207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:04.170067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c12887b97ed4177aed54edf24f98aac', 'request_id': 'req-a1538021-ebf0-4cce-b854-26c8e49f0aa3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.183328 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c12887b97ed4177aed54edf24f98aac', 'request_id': 'req-a1538021-ebf0-4cce-b854-26c8e49f0aa3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.199530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c12887b97ed4177aed54edf24f98aac', 'request_id': 'req-a1538021-ebf0-4cce-b854-26c8e49f0aa3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.218736 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] The token cache is being invalidate because project 7c12887b97ed4177aed54edf24f98aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:04.219042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.220581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.222100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1136/2261] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:03 2022] DELETE /identity/v3/projects/7c12887b97ed4177aed54edf24f98aac => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:04.226855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:04.228357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:04.260993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04129ab-45a4-49c7-9844-8476024f6ddd tempest-VolumeQuotaClassesTest-67413924 tempest-VolumeQuotaClassesTest-67413924-project-admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:04.381918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:04.382731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:04.383016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:04.383298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] PATH_INFO: `/v3/users/958adc4b05564eedaf42f3b9fae18c60` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:04.386214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958adc4b05564eedaf42f3b9fae18c60)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:04.388816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:04.462680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958adc4b05564eedaf42f3b9fae18c60'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.485125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:04.487199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:04.499665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958adc4b05564eedaf42f3b9fae18c60'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.511705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1538021-ebf0-4cce-b854-26c8e49f0aa3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:04.522958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:04.524306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:04.524659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:04.525026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] PATH_INFO: `/v3/users/540fcd4367ac4969afa88f9fb83042df` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:04.526697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=540fcd4367ac4969afa88f9fb83042df)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:04.526829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958adc4b05564eedaf42f3b9fae18c60'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.527888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958adc4b05564eedaf42f3b9fae18c60'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.529567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:04.539015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-da888069-e6c1-46e9-bdec-eb471a29dbb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958adc4b05564eedaf42f3b9fae18c60'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.545103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:04.559498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1126/2262] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:04 2022] DELETE /identity/v3/users/958adc4b05564eedaf42f3b9fae18c60 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:04.612005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540fcd4367ac4969afa88f9fb83042df'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.633969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540fcd4367ac4969afa88f9fb83042df'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.660375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540fcd4367ac4969afa88f9fb83042df'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.661091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540fcd4367ac4969afa88f9fb83042df'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.669590 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540fcd4367ac4969afa88f9fb83042df'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.676501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1137/2263] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:04 2022] DELETE /identity/v3/users/540fcd4367ac4969afa88f9fb83042df => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:04.681301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ec04-b4b3-4a62-8bd8-1135ec662f9a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:04.681680 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ec04-b4b3-4a62-8bd8-1135ec662f9a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:04.681958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ec04-b4b3-4a62-8bd8-1135ec662f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:04.704513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3502ec04-b4b3-4a62-8bd8-1135ec662f9a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:04.705780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3502ec04-b4b3-4a62-8bd8-1135ec662f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:04.757354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:04.792480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1127/2264] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:04.802635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:04.804218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:04.871783 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567cf89-c9d6-4cef-bf03-c976a8c930ac admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:04.878176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eac752-6137-414f-9301-21c2926adf49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:04.879052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac752-6137-414f-9301-21c2926adf49 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:04.879336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac752-6137-414f-9301-21c2926adf49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:04.879682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac752-6137-414f-9301-21c2926adf49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:04.892851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502ec04-b4b3-4a62-8bd8-1135ec662f9a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:04.894452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eac752-6137-414f-9301-21c2926adf49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:04.894580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3502ec04-b4b3-4a62-8bd8-1135ec662f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:04.895957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eac752-6137-414f-9301-21c2926adf49 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:04.907889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1138/2265] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:04.916857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502ec04-b4b3-4a62-8bd8-1135ec662f9a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:04.925291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:04.926396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:04.928183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:04.928526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] PATH_INFO: `/v3/projects/82a0b3f986584426a7f8fa2bf6270755` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:04.931162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a0b3f986584426a7f8fa2bf6270755)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:04.934024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:04.990435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a0b3f986584426a7f8fa2bf6270755', 'request_id': 'req-0f8ba899-7246-4223-89dc-ba5475367df6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:04.997541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a0b3f986584426a7f8fa2bf6270755', 'request_id': 'req-0f8ba899-7246-4223-89dc-ba5475367df6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.004191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a0b3f986584426a7f8fa2bf6270755', 'request_id': 'req-0f8ba899-7246-4223-89dc-ba5475367df6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.017086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] The token cache is being invalidate because project 82a0b3f986584426a7f8fa2bf6270755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:05.017643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.018421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.020152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1128/2266] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:04 2022] DELETE /identity/v3/projects/82a0b3f986584426a7f8fa2bf6270755 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:05.024557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eac752-6137-414f-9301-21c2926adf49 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:05.035193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eac752-6137-414f-9301-21c2926adf49 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:05.126579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:05.127306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:05.127653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:05.127993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] PATH_INFO: `/v3/users/955a49ce192c444ab6bbaf9e9b1ff898` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:05.129475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955a49ce192c444ab6bbaf9e9b1ff898)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:05.131503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:05.171008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:05.186387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955a49ce192c444ab6bbaf9e9b1ff898'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.199569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955a49ce192c444ab6bbaf9e9b1ff898'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.206299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955a49ce192c444ab6bbaf9e9b1ff898'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.206931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955a49ce192c444ab6bbaf9e9b1ff898'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.216574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955a49ce192c444ab6bbaf9e9b1ff898'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.222679 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1139/2267] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:05 2022] DELETE /identity/v3/users/955a49ce192c444ab6bbaf9e9b1ff898 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:05.249570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:05.251250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:05.265653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ba899-7246-4223-89dc-ba5475367df6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:05.334232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:05.335032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:05.335293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:05.335707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] PATH_INFO: `/v3/projects/c8bd91da266245358ba6f2fc48e75607` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:05.337618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bd91da266245358ba6f2fc48e75607)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:05.339580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:05.391521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bd91da266245358ba6f2fc48e75607', 'request_id': 'req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.397602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bd91da266245358ba6f2fc48e75607', 'request_id': 'req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.404012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bd91da266245358ba6f2fc48e75607', 'request_id': 'req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.406916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:05.420666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] The token cache is being invalidate because project c8bd91da266245358ba6f2fc48e75607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:05.420951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.421736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.427896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:05.428755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1129/2268] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:05 2022] DELETE /identity/v3/projects/c8bd91da266245358ba6f2fc48e75607 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:05.429782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:05.442814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392efcd1-3beb-4c4c-9bd1-bf40a30ee9a9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:05.503374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:05.504219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:05.504481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:05.504891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] PATH_INFO: `/v3/users/0bb9f96118884fd9aba9663937fde0b8` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:05.506281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb9f96118884fd9aba9663937fde0b8)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:05.509290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:05.532726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:05.534147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:05.553768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4760b-3c07-4ee7-bf0a-fa8a84d5addb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:05.567621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:05.573555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:05.573555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:05.573555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] PATH_INFO: `/v3/projects/9a4fe5dbdf7649acb695a4a6b5d8bc4d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:05.573555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4fe5dbdf7649acb695a4a6b5d8bc4d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:05.573555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:05.591970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb9f96118884fd9aba9663937fde0b8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.626578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb9f96118884fd9aba9663937fde0b8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.664703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb9f96118884fd9aba9663937fde0b8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.667026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb9f96118884fd9aba9663937fde0b8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.672404 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4fe5dbdf7649acb695a4a6b5d8bc4d', 'request_id': 'req-967313fc-def5-4e94-9f03-14f761960fcf'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.677601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c4cf19bb-2b20-48f7-bf96-4864e46da977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb9f96118884fd9aba9663937fde0b8'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.686070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4fe5dbdf7649acb695a4a6b5d8bc4d', 'request_id': 'req-967313fc-def5-4e94-9f03-14f761960fcf'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.699335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4fe5dbdf7649acb695a4a6b5d8bc4d', 'request_id': 'req-967313fc-def5-4e94-9f03-14f761960fcf'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.712741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1140/2269] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:05 2022] DELETE /identity/v3/users/0bb9f96118884fd9aba9663937fde0b8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:05.727210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] The token cache is being invalidate because project 9a4fe5dbdf7649acb695a4a6b5d8bc4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:05.728536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.730410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-967313fc-def5-4e94-9f03-14f761960fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:05.734505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1130/2270] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:05 2022] DELETE /identity/v3/projects/9a4fe5dbdf7649acb695a4a6b5d8bc4d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:05.744980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763473d-18e5-4d39-830d-8fe6b04b2ffa None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:05.745380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763473d-18e5-4d39-830d-8fe6b04b2ffa None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:05.745610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763473d-18e5-4d39-830d-8fe6b04b2ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:05.780121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5763473d-18e5-4d39-830d-8fe6b04b2ffa None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:05.781616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5763473d-18e5-4d39-830d-8fe6b04b2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:05.819645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:05.876201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1141/2271] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:05.879141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a768-efab-44b6-8c51-6626dde1c78a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:05.879464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a768-efab-44b6-8c51-6626dde1c78a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:05.880264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a768-efab-44b6-8c51-6626dde1c78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:05.909018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fdc4a768-efab-44b6-8c51-6626dde1c78a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:05.910205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fdc4a768-efab-44b6-8c51-6626dde1c78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:05.923000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1131/2272] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:05.929063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763473d-18e5-4d39-830d-8fe6b04b2ffa None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:05.943641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763473d-18e5-4d39-830d-8fe6b04b2ffa None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:05.949199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:05.950097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:05.950619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:05.951028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:05.951807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:05.952167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:05.953999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:05.973521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4a768-efab-44b6-8c51-6626dde1c78a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:05.979626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1142/2273] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:15:05.984003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4a768-efab-44b6-8c51-6626dde1c78a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:05.990294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d78089-46f5-4578-91c3-4313eac7d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:05.990996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d78089-46f5-4578-91c3-4313eac7d696 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:05.992485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d78089-46f5-4578-91c3-4313eac7d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:05.993073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d78089-46f5-4578-91c3-4313eac7d696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:05.993997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d78089-46f5-4578-91c3-4313eac7d696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:05.996234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d78089-46f5-4578-91c3-4313eac7d696 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:06.043018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1132/2274] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:05 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:06.047155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:06.057771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103f39e-08c1-4051-bf0e-a3c7cf70931e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:06.108378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e15c-118a-4299-b6af-298b7c33417a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.108901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e15c-118a-4299-b6af-298b7c33417a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.109178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549e15c-118a-4299-b6af-298b7c33417a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.144289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7549e15c-118a-4299-b6af-298b7c33417a None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:06.147715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7549e15c-118a-4299-b6af-298b7c33417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:06.169273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939190f9-6bb1-437b-9070-35bef4c89100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:06.170622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939190f9-6bb1-437b-9070-35bef4c89100 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.171049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939190f9-6bb1-437b-9070-35bef4c89100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.171551 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939190f9-6bb1-437b-9070-35bef4c89100 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.172707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939190f9-6bb1-437b-9070-35bef4c89100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:06.175021 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939190f9-6bb1-437b-9070-35bef4c89100 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:06.207790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1143/2275] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:06 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:06.212343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939190f9-6bb1-437b-9070-35bef4c89100 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:06.240618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939190f9-6bb1-437b-9070-35bef4c89100 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:06.256233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9204b03-e748-4668-8a7a-bf9403c25171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:06.256570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9204b03-e748-4668-8a7a-bf9403c25171 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.257081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9204b03-e748-4668-8a7a-bf9403c25171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.257334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9204b03-e748-4668-8a7a-bf9403c25171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.258528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9204b03-e748-4668-8a7a-bf9403c25171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:06.260462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9204b03-e748-4668-8a7a-bf9403c25171 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:06.299950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1144/2276] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:06.301009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1133/2277] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:06.301382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9204b03-e748-4668-8a7a-bf9403c25171 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:06.302870 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549e15c-118a-4299-b6af-298b7c33417a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:06.314245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7549e15c-118a-4299-b6af-298b7c33417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:06.330091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9204b03-e748-4668-8a7a-bf9403c25171 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:06.343305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40e4aa-7252-4f29-8398-3a3c56b371f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:06.344286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e4aa-7252-4f29-8398-3a3c56b371f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.344573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e4aa-7252-4f29-8398-3a3c56b371f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.344852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e4aa-7252-4f29-8398-3a3c56b371f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.345539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40e4aa-7252-4f29-8398-3a3c56b371f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:06.348467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40e4aa-7252-4f29-8398-3a3c56b371f2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:06.371094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1145/2278] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:06.377067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40e4aa-7252-4f29-8398-3a3c56b371f2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:06.398964 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40e4aa-7252-4f29-8398-3a3c56b371f2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:06.412365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750708c2-b0ee-447e-af9a-509c33059b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:06.412728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750708c2-b0ee-447e-af9a-509c33059b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.413213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750708c2-b0ee-447e-af9a-509c33059b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.413321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750708c2-b0ee-447e-af9a-509c33059b82 admin admin] PATH_INFO: `/v3/projects/31b6a9fc6b7442b3af1634e7b0cc4981/users/684ec685aa624b0a81bdd10779b1a518/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.415633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:06.456527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750708c2-b0ee-447e-af9a-509c33059b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b6a9fc6b7442b3af1634e7b0cc4981, user_id=684ec685aa624b0a81bdd10779b1a518, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:06.460234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750708c2-b0ee-447e-af9a-509c33059b82 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:06.474953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549e15c-118a-4299-b6af-298b7c33417a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:06.482838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01b9a4-0bb2-4fbf-82dc-d41763aa006d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:06.483573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b9a4-0bb2-4fbf-82dc-d41763aa006d service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.484160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b9a4-0bb2-4fbf-82dc-d41763aa006d service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.484435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01b9a4-0bb2-4fbf-82dc-d41763aa006d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.488865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1146/2279] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:06 2022] PUT /identity/v3/projects/31b6a9fc6b7442b3af1634e7b0cc4981/users/684ec685aa624b0a81bdd10779b1a518/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:06.496380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01b9a4-0bb2-4fbf-82dc-d41763aa006d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:06.498740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01b9a4-0bb2-4fbf-82dc-d41763aa006d service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:06.504049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bb7f3-62f3-457d-928b-3f5bf2bfb681 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.504393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bb7f3-62f3-457d-928b-3f5bf2bfb681 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.504693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bb7f3-62f3-457d-928b-3f5bf2bfb681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.511366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1134/2280] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:15:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:15:06.569430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-592bb7f3-62f3-457d-928b-3f5bf2bfb681 None None] MFA Rules not processed for user `684ec685aa624b0a81bdd10779b1a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:06.572090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-592bb7f3-62f3-457d-928b-3f5bf2bfb681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:06.651654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:06.694929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1147/2281] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:06.699889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01b9a4-0bb2-4fbf-82dc-d41763aa006d service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:06.722757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01b9a4-0bb2-4fbf-82dc-d41763aa006d service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:06.753347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bb7f3-62f3-457d-928b-3f5bf2bfb681 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:06.755087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-592bb7f3-62f3-457d-928b-3f5bf2bfb681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:06.899581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0280db-340f-4bc0-8a9c-f696c5e5dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:06.901448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0280db-340f-4bc0-8a9c-f696c5e5dbbc admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.903201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0280db-340f-4bc0-8a9c-f696c5e5dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.903492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0280db-340f-4bc0-8a9c-f696c5e5dbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.904548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0280db-340f-4bc0-8a9c-f696c5e5dbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:06.914752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0280db-340f-4bc0-8a9c-f696c5e5dbbc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:06.947466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bb7f3-62f3-457d-928b-3f5bf2bfb681 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:06.964288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:06.964954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:06.965236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:06.965536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] PATH_INFO: `/v3/projects/25451d02678e4acab202d3d6be9aa599` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:06.973489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=25451d02678e4acab202d3d6be9aa599)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:06.978098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:07.001914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1135/2282] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:06 2022] POST /identity/v3/projects => generated 379 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:07.008642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0280db-340f-4bc0-8a9c-f696c5e5dbbc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:07.140703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25451d02678e4acab202d3d6be9aa599', 'request_id': 'req-26323619-2e66-44ee-b728-832bca9245dd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:07.162995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25451d02678e4acab202d3d6be9aa599', 'request_id': 'req-26323619-2e66-44ee-b728-832bca9245dd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:07.177693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25451d02678e4acab202d3d6be9aa599', 'request_id': 'req-26323619-2e66-44ee-b728-832bca9245dd'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:07.196978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] The token cache is being invalidate because project 25451d02678e4acab202d3d6be9aa599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:07.198698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:07.201103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26323619-2e66-44ee-b728-832bca9245dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:07.206824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1148/2283] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:06 2022] DELETE /identity/v3/projects/25451d02678e4acab202d3d6be9aa599 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:07.212737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8660ff-a720-4fa7-b627-e44b70e53be1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.213340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8660ff-a720-4fa7-b627-e44b70e53be1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.214316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8660ff-a720-4fa7-b627-e44b70e53be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.234414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0280db-340f-4bc0-8a9c-f696c5e5dbbc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:07.264888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1d8660ff-a720-4fa7-b627-e44b70e53be1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:07.266499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1d8660ff-a720-4fa7-b627-e44b70e53be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:07.380439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1149/2284] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:07.388164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d251074-ad25-49b4-b044-56b982049c7b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.389208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d251074-ad25-49b4-b044-56b982049c7b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.389535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d251074-ad25-49b4-b044-56b982049c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.410415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:07.416597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6d251074-ad25-49b4-b044-56b982049c7b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:07.416794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.417050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.417394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.417908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6d251074-ad25-49b4-b044-56b982049c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:07.418159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:07.422415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:07.432341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1150/2285] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:07.433562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d251074-ad25-49b4-b044-56b982049c7b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:07.446654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d251074-ad25-49b4-b044-56b982049c7b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:07.455794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:07.456946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.457236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.457544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.458573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:07.459500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:07.463148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:07.477657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1136/2286] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:07 2022] POST /identity/v3/users => generated 290 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:07.498094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:07.504765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:07.505662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:07.514216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1151/2287] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:15:07.518162 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:07.539802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:07.546119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7675c39-8aba-4d33-b030-a3b255bb8999 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:07.553655 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c178249-5c8b-40e8-b82f-3733c01241cb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:07.563320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac7ec-1050-4cdb-a60e-4a30a9c49d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:07.563981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac7ec-1050-4cdb-a60e-4a30a9c49d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.564213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac7ec-1050-4cdb-a60e-4a30a9c49d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.564481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac7ec-1050-4cdb-a60e-4a30a9c49d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.565136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeac7ec-1050-4cdb-a60e-4a30a9c49d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:07.566868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeac7ec-1050-4cdb-a60e-4a30a9c49d81 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:07.568856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cef13e-ec58-46c8-a685-5335f121852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:07.569557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cef13e-ec58-46c8-a685-5335f121852f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.571055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cef13e-ec58-46c8-a685-5335f121852f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.571366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cef13e-ec58-46c8-a685-5335f121852f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.572071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cef13e-ec58-46c8-a685-5335f121852f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:07.577587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cef13e-ec58-46c8-a685-5335f121852f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:07.592984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1137/2288] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:07.599352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac7ec-1050-4cdb-a60e-4a30a9c49d81 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:07.617724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac7ec-1050-4cdb-a60e-4a30a9c49d81 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:07.633516 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ae388-7a88-4ef2-9afd-3861177c054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:07.634378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ae388-7a88-4ef2-9afd-3861177c054e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.635434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ae388-7a88-4ef2-9afd-3861177c054e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.636276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ae388-7a88-4ef2-9afd-3861177c054e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.638461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ae388-7a88-4ef2-9afd-3861177c054e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:07.644163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1152/2289] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:07 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:07.644470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ae388-7a88-4ef2-9afd-3861177c054e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:07.645813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cef13e-ec58-46c8-a685-5335f121852f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:07.688802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1138/2290] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:07.695375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ae388-7a88-4ef2-9afd-3861177c054e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:07.730282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ae388-7a88-4ef2-9afd-3861177c054e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:07.856001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cef13e-ec58-46c8-a685-5335f121852f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:07.865712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23ca-baed-407e-bc5d-65045a98d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:07.866642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23ca-baed-407e-bc5d-65045a98d48c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.868040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23ca-baed-407e-bc5d-65045a98d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.869454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23ca-baed-407e-bc5d-65045a98d48c admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.870601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb23ca-baed-407e-bc5d-65045a98d48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:07.874202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb23ca-baed-407e-bc5d-65045a98d48c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:07.900254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b966af-760c-45ce-89b9-a551e8b8ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:07.900930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b966af-760c-45ce-89b9-a551e8b8ff6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.901207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b966af-760c-45ce-89b9-a551e8b8ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.901527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b966af-760c-45ce-89b9-a551e8b8ff6e admin admin] PATH_INFO: `/v3/projects/bbcafbf24d9d458b99100ba7e2c853ef/users/6a0ddbeb91a94ff1bfb03c88e8df7606/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:07.943535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1153/2291] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:07 2022] POST /identity/v3/users => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:07.943782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b966af-760c-45ce-89b9-a551e8b8ff6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcafbf24d9d458b99100ba7e2c853ef, user_id=6a0ddbeb91a94ff1bfb03c88e8df7606, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:07.944818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23ca-baed-407e-bc5d-65045a98d48c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:07.950598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b966af-760c-45ce-89b9-a551e8b8ff6e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:07.971863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23ca-baed-407e-bc5d-65045a98d48c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:07.983117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1139/2292] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:07 2022] PUT /identity/v3/projects/bbcafbf24d9d458b99100ba7e2c853ef/users/6a0ddbeb91a94ff1bfb03c88e8df7606/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:07.996394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b7c7e-ae60-4f00-8a99-97997d1526ac None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:07.996689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b7c7e-ae60-4f00-8a99-97997d1526ac None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:07.997380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b7c7e-ae60-4f00-8a99-97997d1526ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:08.052353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-433b7c7e-ae60-4f00-8a99-97997d1526ac None None] MFA Rules not processed for user `6a0ddbeb91a94ff1bfb03c88e8df7606`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:08.053284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-433b7c7e-ae60-4f00-8a99-97997d1526ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:08.099605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e143d21-8f26-4681-bba9-46a63fed20ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:08.100490 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e143d21-8f26-4681-bba9-46a63fed20ab admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:08.100770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e143d21-8f26-4681-bba9-46a63fed20ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:08.101092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e143d21-8f26-4681-bba9-46a63fed20ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:08.101827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e143d21-8f26-4681-bba9-46a63fed20ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:08.103430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e143d21-8f26-4681-bba9-46a63fed20ab admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:08.119057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1154/2293] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:08.120015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e143d21-8f26-4681-bba9-46a63fed20ab admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:08.131555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e143d21-8f26-4681-bba9-46a63fed20ab admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:08.137879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faf7c2-6011-4084-aef1-34cd83bdda61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:08.138516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf7c2-6011-4084-aef1-34cd83bdda61 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:08.138845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf7c2-6011-4084-aef1-34cd83bdda61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:08.139469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf7c2-6011-4084-aef1-34cd83bdda61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:08.140136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faf7c2-6011-4084-aef1-34cd83bdda61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:08.141782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faf7c2-6011-4084-aef1-34cd83bdda61 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:08.154724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1155/2294] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:08.159237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faf7c2-6011-4084-aef1-34cd83bdda61 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:08.172070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faf7c2-6011-4084-aef1-34cd83bdda61 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:08.177196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62042af6-ccf7-4300-ba18-332f69981dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:08.177930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042af6-ccf7-4300-ba18-332f69981dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:08.178212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042af6-ccf7-4300-ba18-332f69981dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:08.178481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042af6-ccf7-4300-ba18-332f69981dab admin admin] PATH_INFO: `/v3/projects/72eac69d22e54e28b5aad41b05042ffd/users/3cfe1ba481414a809966192b4f1d9e4a/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:08.198648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62042af6-ccf7-4300-ba18-332f69981dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=72eac69d22e54e28b5aad41b05042ffd, user_id=3cfe1ba481414a809966192b4f1d9e4a, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:08.202690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62042af6-ccf7-4300-ba18-332f69981dab admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:08.220247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1140/2295] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:08.232716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b7c7e-ae60-4f00-8a99-97997d1526ac None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:08.246444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1156/2296] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:08 2022] PUT /identity/v3/projects/72eac69d22e54e28b5aad41b05042ffd/users/3cfe1ba481414a809966192b4f1d9e4a/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:08.262177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b7c7e-ae60-4f00-8a99-97997d1526ac None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:08.263817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3e7e9-ff21-4b84-8807-c800714a4a78 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:08.267487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3e7e9-ff21-4b84-8807-c800714a4a78 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:08.269504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3e7e9-ff21-4b84-8807-c800714a4a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:08.400165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-62f3e7e9-ff21-4b84-8807-c800714a4a78 None None] MFA Rules not processed for user `3cfe1ba481414a809966192b4f1d9e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:08.405424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-62f3e7e9-ff21-4b84-8807-c800714a4a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:08.460583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:08.475934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:08.495141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2451fa-f1b6-4c87-8e0c-7567b1077347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:08.497055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2451fa-f1b6-4c87-8e0c-7567b1077347 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:08.497357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2451fa-f1b6-4c87-8e0c-7567b1077347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:08.497667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2451fa-f1b6-4c87-8e0c-7567b1077347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:08.514716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2451fa-f1b6-4c87-8e0c-7567b1077347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:08.524255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2451fa-f1b6-4c87-8e0c-7567b1077347 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:08.590982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1141/2297] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:08 2022] POST /identity/v3/projects => generated 379 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:08.594908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2451fa-f1b6-4c87-8e0c-7567b1077347 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:08.599114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1157/2298] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:08.605739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3e7e9-ff21-4b84-8807-c800714a4a78 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:08.631013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3e7e9-ff21-4b84-8807-c800714a4a78 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:08.794443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2451fa-f1b6-4c87-8e0c-7567b1077347 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:08.806865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f68c00-d7b1-4a56-966a-a0f4987ec8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:08.807374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f68c00-d7b1-4a56-966a-a0f4987ec8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:08.807707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f68c00-d7b1-4a56-966a-a0f4987ec8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:08.807933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f68c00-d7b1-4a56-966a-a0f4987ec8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:08.808632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f68c00-d7b1-4a56-966a-a0f4987ec8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:08.810346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32873614-bfee-4f1e-b579-4136bd901c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:08.811296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f68c00-d7b1-4a56-966a-a0f4987ec8b7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:08.814300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32873614-bfee-4f1e-b579-4136bd901c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:08.815938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32873614-bfee-4f1e-b579-4136bd901c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:08.816485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32873614-bfee-4f1e-b579-4136bd901c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:08.817743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32873614-bfee-4f1e-b579-4136bd901c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:08.823745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32873614-bfee-4f1e-b579-4136bd901c11 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:08.891322 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1142/2299] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:08 2022] POST /identity/v3/users => generated 296 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:08.895726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f68c00-d7b1-4a56-966a-a0f4987ec8b7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:08.908833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1158/2300] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:08 2022] POST /identity/v3/projects => generated 401 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:08.913191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32873614-bfee-4f1e-b579-4136bd901c11 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:08.927669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f68c00-d7b1-4a56-966a-a0f4987ec8b7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.112627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32873614-bfee-4f1e-b579-4136bd901c11 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.117048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886802-7a40-42f8-a49a-fc716e6480bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.117816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886802-7a40-42f8-a49a-fc716e6480bc admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.118684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886802-7a40-42f8-a49a-fc716e6480bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.119661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82886802-7a40-42f8-a49a-fc716e6480bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.120700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82886802-7a40-42f8-a49a-fc716e6480bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.122514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82886802-7a40-42f8-a49a-fc716e6480bc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.127357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a5178-52aa-41d1-ad8a-5b9de6b44810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.128092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a5178-52aa-41d1-ad8a-5b9de6b44810 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.128786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a5178-52aa-41d1-ad8a-5b9de6b44810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.129675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a5178-52aa-41d1-ad8a-5b9de6b44810 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.130981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a5178-52aa-41d1-ad8a-5b9de6b44810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.133709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a5178-52aa-41d1-ad8a-5b9de6b44810 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.156660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1143/2301] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:09.159351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886802-7a40-42f8-a49a-fc716e6480bc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:09.195280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82886802-7a40-42f8-a49a-fc716e6480bc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.199279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1159/2302] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:08 2022] POST /identity/v3/users => generated 307 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:09.203903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a5178-52aa-41d1-ad8a-5b9de6b44810 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:09.215429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f2909-d948-4d24-a45a-cff0399bce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.218553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2909-d948-4d24-a45a-cff0399bce87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.219550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2909-d948-4d24-a45a-cff0399bce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.220895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2909-d948-4d24-a45a-cff0399bce87 admin admin] PATH_INFO: `/v3/projects/23bc87a9d7b2420aa09568f20fc2a5f8/users/a33061a869404e959bc5a82592e230d3/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.238378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a5178-52aa-41d1-ad8a-5b9de6b44810 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.261533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccfc0-217f-49c0-8f31-f43e6f50ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.262243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccfc0-217f-49c0-8f31-f43e6f50ac2c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.262556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccfc0-217f-49c0-8f31-f43e6f50ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.262849 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccfc0-217f-49c0-8f31-f43e6f50ac2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.263523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ccfc0-217f-49c0-8f31-f43e6f50ac2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.292889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f2909-d948-4d24-a45a-cff0399bce87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bc87a9d7b2420aa09568f20fc2a5f8, user_id=a33061a869404e959bc5a82592e230d3, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.294090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ccfc0-217f-49c0-8f31-f43e6f50ac2c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.301549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f2909-d948-4d24-a45a-cff0399bce87 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.315003 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1160/2303] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:09.329862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccfc0-217f-49c0-8f31-f43e6f50ac2c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:09.344878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccfc0-217f-49c0-8f31-f43e6f50ac2c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.356493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1144/2304] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:09 2022] PUT /identity/v3/projects/23bc87a9d7b2420aa09568f20fc2a5f8/users/a33061a869404e959bc5a82592e230d3/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:09.359495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f2909-d948-4d24-a45a-cff0399bce87 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:09.398056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:09.497187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.498723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.498723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.498723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] PATH_INFO: `/v3/projects/b56ed12124474db898e4ef5a911158f5/users/147dc136aa524ca3b9e039c2a5eb3811/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.529932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:09.536554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56ed12124474db898e4ef5a911158f5, user_id=147dc136aa524ca3b9e039c2a5eb3811, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.543555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.573422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1161/2305] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:09 2022] PUT /identity/v3/projects/b56ed12124474db898e4ef5a911158f5/users/147dc136aa524ca3b9e039c2a5eb3811/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:09.574347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:09.583210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:09.588706 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f2909-d948-4d24-a45a-cff0399bce87 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.725270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9532a4-7b78-48c0-b889-88dcabefee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.727289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9532a4-7b78-48c0-b889-88dcabefee46 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.727656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9532a4-7b78-48c0-b889-88dcabefee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.728548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9532a4-7b78-48c0-b889-88dcabefee46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.730179 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9532a4-7b78-48c0-b889-88dcabefee46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.734330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9532a4-7b78-48c0-b889-88dcabefee46 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.747621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f29e4-61bf-4df3-b017-c4961a487059 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.764977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1145/2306] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:09.764977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9532a4-7b78-48c0-b889-88dcabefee46 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:09.775701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.776387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.776764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.777137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] PATH_INFO: `/v3/users/bf5b2a3df1a24f2eba77ce14e9770905` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.778514 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5b2a3df1a24f2eba77ce14e9770905)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.780547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.792745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9532a4-7b78-48c0-b889-88dcabefee46 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.810441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1df9f-2711-4625-806c-9162a54eacd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.811326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1df9f-2711-4625-806c-9162a54eacd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.811656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1df9f-2711-4625-806c-9162a54eacd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.812051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1df9f-2711-4625-806c-9162a54eacd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.815602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1df9f-2711-4625-806c-9162a54eacd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.822055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1df9f-2711-4625-806c-9162a54eacd5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.850737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1146/2307] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:09.853165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1df9f-2711-4625-806c-9162a54eacd5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:09.874335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5b2a3df1a24f2eba77ce14e9770905'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:09.886661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1df9f-2711-4625-806c-9162a54eacd5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:09.902496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052a2dd-b4e3-470a-a291-090f7aaada90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:09.903566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052a2dd-b4e3-470a-a291-090f7aaada90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.903964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052a2dd-b4e3-470a-a291-090f7aaada90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.904353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052a2dd-b4e3-470a-a291-090f7aaada90 admin admin] PATH_INFO: `/v3/projects/23bc87a9d7b2420aa09568f20fc2a5f8/users/a33061a869404e959bc5a82592e230d3/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:09.906690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052a2dd-b4e3-470a-a291-090f7aaada90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bc87a9d7b2420aa09568f20fc2a5f8, user_id=a33061a869404e959bc5a82592e230d3, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:09.909845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052a2dd-b4e3-470a-a291-090f7aaada90 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:09.932182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1147/2308] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:09 2022] PUT /identity/v3/projects/23bc87a9d7b2420aa09568f20fc2a5f8/users/a33061a869404e959bc5a82592e230d3/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:09.933350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052a2dd-b4e3-470a-a291-090f7aaada90 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:09.947461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5b2a3df1a24f2eba77ce14e9770905'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:09.959143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5b2a3df1a24f2eba77ce14e9770905'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:09.961767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5b2a3df1a24f2eba77ce14e9770905'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:09.971478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a4807c90-0861-4b03-8d95-978aa0fecf14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5b2a3df1a24f2eba77ce14e9770905'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:09.982764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1162/2309] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:09 2022] DELETE /identity/v3/users/bf5b2a3df1a24f2eba77ce14e9770905 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:09.984350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2272d9-2868-4ac8-a576-cf12414afc2c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:09.984660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2272d9-2868-4ac8-a576-cf12414afc2c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:09.984941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2272d9-2868-4ac8-a576-cf12414afc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:10.021743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8c2272d9-2868-4ac8-a576-cf12414afc2c None None] MFA Rules not processed for user `a33061a869404e959bc5a82592e230d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:10.023214 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8c2272d9-2868-4ac8-a576-cf12414afc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:10.038012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:10.084547 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052a2dd-b4e3-470a-a291-090f7aaada90 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:10.118698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1163/2310] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:10.123469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991ced-3ca0-4734-a60f-7c7f68df1954 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:10.123469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991ced-3ca0-4734-a60f-7c7f68df1954 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:10.123469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991ced-3ca0-4734-a60f-7c7f68df1954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:10.160984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:10.162477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:10.162967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:10.163510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] PATH_INFO: `/v3/projects/b56ed12124474db898e4ef5a911158f5/users/147dc136aa524ca3b9e039c2a5eb3811/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:10.165898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56ed12124474db898e4ef5a911158f5, user_id=147dc136aa524ca3b9e039c2a5eb3811, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:10.167265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d0991ced-3ca0-4734-a60f-7c7f68df1954 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:10.168520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d0991ced-3ca0-4734-a60f-7c7f68df1954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:10.169601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:10.181082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1164/2311] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:10.181990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0991ced-3ca0-4734-a60f-7c7f68df1954 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:10.182526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1148/2312] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:09 2022] PUT /identity/v3/projects/b56ed12124474db898e4ef5a911158f5/users/147dc136aa524ca3b9e039c2a5eb3811/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:10.190387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d0991ced-3ca0-4734-a60f-7c7f68df1954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:10.191561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:10.193378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:10.207012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:10.270905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0991ced-3ca0-4734-a60f-7c7f68df1954 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:10.273347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f0de5-1ad8-470a-8a32-83e3ca086109 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:10.278658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f3a9d-ddcf-4a3d-a1f8-f14d51a9c458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:10.279416 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f3a9d-ddcf-4a3d-a1f8-f14d51a9c458 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:10.279799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f3a9d-ddcf-4a3d-a1f8-f14d51a9c458 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:10.280172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f3a9d-ddcf-4a3d-a1f8-f14d51a9c458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:10.403493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f3a9d-ddcf-4a3d-a1f8-f14d51a9c458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:10.405218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f3a9d-ddcf-4a3d-a1f8-f14d51a9c458 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:10.409978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e37783-58d9-4828-ac5a-5b9a18780452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:10.410611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e37783-58d9-4828-ac5a-5b9a18780452 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:10.410894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e37783-58d9-4828-ac5a-5b9a18780452 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:10.411167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e37783-58d9-4828-ac5a-5b9a18780452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:10.432818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1149/2313] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:10.434838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9e40-df16-44c6-ba71-a214fe8dbf61 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:10.435373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9e40-df16-44c6-ba71-a214fe8dbf61 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:10.435853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9e40-df16-44c6-ba71-a214fe8dbf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:10.503842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-83ce9e40-df16-44c6-ba71-a214fe8dbf61 None None] MFA Rules not processed for user `147dc136aa524ca3b9e039c2a5eb3811`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:10.505604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-83ce9e40-df16-44c6-ba71-a214fe8dbf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:10.555040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e37783-58d9-4828-ac5a-5b9a18780452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:10.557061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e37783-58d9-4828-ac5a-5b9a18780452 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:10.572149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1165/2314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:10.657235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e37783-58d9-4828-ac5a-5b9a18780452 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:10.675190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e37783-58d9-4828-ac5a-5b9a18780452 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:10.682045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1150/2315] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:10.683252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:10.684212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:10.684693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:10.685143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:10.688275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:10.699553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:10.861567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce9e40-df16-44c6-ba71-a214fe8dbf61 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:10.863178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-83ce9e40-df16-44c6-ba71-a214fe8dbf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:10.870769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:10.872223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:10.884719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce9e40-df16-44c6-ba71-a214fe8dbf61 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:10.894770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:10.895407 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:10.895753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:10.896032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:10.897956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1166/2316] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:10.913981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:10.916585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:10.946425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1151/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:10 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:15:11.208367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:11.226299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f6fc-35e8-4e80-8f21-4c9d3919ccd4 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:11.231995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d291ca-98ee-449b-b184-938044d48aed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:11.233001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d291ca-98ee-449b-b184-938044d48aed service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:11.233362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d291ca-98ee-449b-b184-938044d48aed service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:11.233755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d291ca-98ee-449b-b184-938044d48aed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:11.236877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f4d291ca-98ee-449b-b184-938044d48aed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:11.273785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:11.275415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:11.316442 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1edbe-6881-445a-8eb4-53dde6ed5532 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:11.326501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:11.329107 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:11.329489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:11.329886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] PATH_INFO: `/v3/projects/025d834d4e6c42af8c257ed024a873b3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:11.337301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=025d834d4e6c42af8c257ed024a873b3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:11.339695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:11.377015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:11.388229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d291ca-98ee-449b-b184-938044d48aed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:11.390463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d291ca-98ee-449b-b184-938044d48aed service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:11.425889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1167/2318] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:11.426101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025d834d4e6c42af8c257ed024a873b3', 'request_id': 'req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:11.448709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025d834d4e6c42af8c257ed024a873b3', 'request_id': 'req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:11.461483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025d834d4e6c42af8c257ed024a873b3', 'request_id': 'req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:11.482662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] The token cache is being invalidate because project 025d834d4e6c42af8c257ed024a873b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:11.483076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:11.483804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f4f6203b-e26a-4ab4-94b9-91fe3a4ef28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:11.486884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1152/2319] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:11 2022] DELETE /identity/v3/projects/025d834d4e6c42af8c257ed024a873b3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:11.495176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9e9f6-abdd-4fdf-bed5-a23babb82455 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:11.495555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9e9f6-abdd-4fdf-bed5-a23babb82455 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:11.495746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9e9f6-abdd-4fdf-bed5-a23babb82455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:11.544379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d7d9e9f6-abdd-4fdf-bed5-a23babb82455 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:11.551656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d7d9e9f6-abdd-4fdf-bed5-a23babb82455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:11.715023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1168/2320] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:11.726584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5c179-30ce-4c6c-af57-89cc40c37049 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:11.727098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5c179-30ce-4c6c-af57-89cc40c37049 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:11.727390 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5c179-30ce-4c6c-af57-89cc40c37049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:11.783791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4ac5c179-30ce-4c6c-af57-89cc40c37049 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:11.790525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4ac5c179-30ce-4c6c-af57-89cc40c37049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:11.818968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1153/2321] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:11.820752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9e9f6-abdd-4fdf-bed5-a23babb82455 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:11.843580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9e9f6-abdd-4fdf-bed5-a23babb82455 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:11.859371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:11.860019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:11.862153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:11.862387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:11.865040 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:11.865369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:11.875700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:11.933718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1169/2322] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:15:11.938402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5c179-30ce-4c6c-af57-89cc40c37049 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:11.955836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5c179-30ce-4c6c-af57-89cc40c37049 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:11.966156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a59f0-3fff-4a6c-9778-64d047d96509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:11.967058 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a59f0-3fff-4a6c-9778-64d047d96509 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:11.967356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a59f0-3fff-4a6c-9778-64d047d96509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:11.967642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a59f0-3fff-4a6c-9778-64d047d96509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:11.968303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a59f0-3fff-4a6c-9778-64d047d96509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:11.974369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a59f0-3fff-4a6c-9778-64d047d96509 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:12.035085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1154/2323] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:11 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:12.036393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:12.059081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b492f1-dc1d-4155-9659-4ad2b86ca651 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:12.203039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:12.295929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292fa0-3a58-463b-96f9-279960d5a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:12.295929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292fa0-3a58-463b-96f9-279960d5a093 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:12.295929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292fa0-3a58-463b-96f9-279960d5a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:12.295929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292fa0-3a58-463b-96f9-279960d5a093 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:12.296329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292fa0-3a58-463b-96f9-279960d5a093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:12.296632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292fa0-3a58-463b-96f9-279960d5a093 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:12.371033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1170/2324] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:12 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:12.375264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a59f0-3fff-4a6c-9778-64d047d96509 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:12.407970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a59f0-3fff-4a6c-9778-64d047d96509 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:12.414120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed480e-8e9f-4fe4-ae34-e085d7fce4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:12.414882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed480e-8e9f-4fe4-ae34-e085d7fce4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:12.415237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed480e-8e9f-4fe4-ae34-e085d7fce4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:12.415969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed480e-8e9f-4fe4-ae34-e085d7fce4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:12.416976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed480e-8e9f-4fe4-ae34-e085d7fce4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:12.418916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed480e-8e9f-4fe4-ae34-e085d7fce4bf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:12.444182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1155/2325] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:12.448692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292fa0-3a58-463b-96f9-279960d5a093 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:12.460046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292fa0-3a58-463b-96f9-279960d5a093 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:12.473642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bad90-d46e-4244-b678-2bf54197de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:12.474293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bad90-d46e-4244-b678-2bf54197de51 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:12.474584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bad90-d46e-4244-b678-2bf54197de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:12.474863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bad90-d46e-4244-b678-2bf54197de51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:12.476788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bad90-d46e-4244-b678-2bf54197de51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:12.480203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bad90-d46e-4244-b678-2bf54197de51 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:12.509628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1171/2326] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:12.519421 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed480e-8e9f-4fe4-ae34-e085d7fce4bf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:12.547806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed480e-8e9f-4fe4-ae34-e085d7fce4bf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:12.562372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:12.563086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:12.563369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:12.563769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] PATH_INFO: `/v3/projects/7dbf8e284b834e5485e2c842791ca4d6/users/13ebe5d1da8641b5a5695c904e21273f/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:12.596285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbf8e284b834e5485e2c842791ca4d6, user_id=13ebe5d1da8641b5a5695c904e21273f, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:12.599194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:12.631929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1156/2327] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:12 2022] PUT /identity/v3/projects/7dbf8e284b834e5485e2c842791ca4d6/users/13ebe5d1da8641b5a5695c904e21273f/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:12.634066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa4c3-3316-4dc1-9c16-849d7c69d71d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:12.634360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa4c3-3316-4dc1-9c16-849d7c69d71d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:12.634631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa4c3-3316-4dc1-9c16-849d7c69d71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:12.711683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e15aa4c3-3316-4dc1-9c16-849d7c69d71d None None] MFA Rules not processed for user `13ebe5d1da8641b5a5695c904e21273f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:12.713821 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e15aa4c3-3316-4dc1-9c16-849d7c69d71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:12.815667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1172/2328] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:12.839821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:12.842893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:12.948786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167a81-073e-47d9-a8db-4e55543d76c5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:12.959358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7a1e5-2428-4ef7-9513-c437379ce6e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:12.960204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7a1e5-2428-4ef7-9513-c437379ce6e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:12.960739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7a1e5-2428-4ef7-9513-c437379ce6e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:12.961159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7a1e5-2428-4ef7-9513-c437379ce6e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:12.971112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7a1e5-2428-4ef7-9513-c437379ce6e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:12.972993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7a1e5-2428-4ef7-9513-c437379ce6e7 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:12.992226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1157/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:15.325336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aa4c3-3316-4dc1-9c16-849d7c69d71d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:15.333839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e15aa4c3-3316-4dc1-9c16-849d7c69d71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:15.416126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aa4c3-3316-4dc1-9c16-849d7c69d71d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:15.423253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:15.423904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:15.424206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:15.424593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] PATH_INFO: `/v3/users/684ec685aa624b0a81bdd10779b1a518` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:15.425837 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=684ec685aa624b0a81bdd10779b1a518)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:15.427825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:15.502472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:15.523613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684ec685aa624b0a81bdd10779b1a518'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:15.556571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684ec685aa624b0a81bdd10779b1a518'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:15.567263 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684ec685aa624b0a81bdd10779b1a518'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:15.569199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684ec685aa624b0a81bdd10779b1a518'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:15.591959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684ec685aa624b0a81bdd10779b1a518'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:15.612626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1173/2330] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:15 2022] DELETE /identity/v3/users/684ec685aa624b0a81bdd10779b1a518 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:15.620205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e0ad-0686-40d6-ac85-4425509908e7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:15.621259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e0ad-0686-40d6-ac85-4425509908e7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:15.621781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e0ad-0686-40d6-ac85-4425509908e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:15.652210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2f15e0ad-0686-40d6-ac85-4425509908e7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:15.653574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2f15e0ad-0686-40d6-ac85-4425509908e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:15.702924 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:15.726422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1158/2331] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:15.736807 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:15.738567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:15.802678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1afef-240e-4b74-8cc9-eb3b96e4ca4d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:15.810001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bf40-39fc-497f-bb51-19877eeff7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:15.810746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bf40-39fc-497f-bb51-19877eeff7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:15.811114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bf40-39fc-497f-bb51-19877eeff7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:15.811464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bf40-39fc-497f-bb51-19877eeff7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:15.821887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4bf40-39fc-497f-bb51-19877eeff7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:15.823332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4bf40-39fc-497f-bb51-19877eeff7f3 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:15.834039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1174/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:16.139751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15e0ad-0686-40d6-ac85-4425509908e7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:16.141220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2f15e0ad-0686-40d6-ac85-4425509908e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:16.153232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15e0ad-0686-40d6-ac85-4425509908e7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:16.158048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:16.158684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:16.158964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:16.159234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] PATH_INFO: `/v3/projects/31b6a9fc6b7442b3af1634e7b0cc4981` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:16.160820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b6a9fc6b7442b3af1634e7b0cc4981)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:16.162780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:16.221966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b6a9fc6b7442b3af1634e7b0cc4981', 'request_id': 'req-457283cc-cb12-4213-8ee1-fbd6e1ae2426'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.228361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b6a9fc6b7442b3af1634e7b0cc4981', 'request_id': 'req-457283cc-cb12-4213-8ee1-fbd6e1ae2426'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.234788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b6a9fc6b7442b3af1634e7b0cc4981', 'request_id': 'req-457283cc-cb12-4213-8ee1-fbd6e1ae2426'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.248562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] The token cache is being invalidate because project 31b6a9fc6b7442b3af1634e7b0cc4981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:16.248858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.249520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.251020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1159/2333] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:16 2022] DELETE /identity/v3/projects/31b6a9fc6b7442b3af1634e7b0cc4981 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:16.255326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bf40-39fc-497f-bb51-19877eeff7f3 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:16.265111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bf40-39fc-497f-bb51-19877eeff7f3 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:16.329190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:16.329934 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:16.330208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:16.330428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] PATH_INFO: `/v3/users/6a0ddbeb91a94ff1bfb03c88e8df7606` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:16.331841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0ddbeb91a94ff1bfb03c88e8df7606)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:16.334011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:16.425824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0ddbeb91a94ff1bfb03c88e8df7606'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.439326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0ddbeb91a94ff1bfb03c88e8df7606'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.441109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:16.449106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0ddbeb91a94ff1bfb03c88e8df7606'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.450987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0ddbeb91a94ff1bfb03c88e8df7606'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.459268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0ddbeb91a94ff1bfb03c88e8df7606'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.467279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1175/2334] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:16 2022] DELETE /identity/v3/users/6a0ddbeb91a94ff1bfb03c88e8df7606 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:16.676126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:16.678069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:16.694307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457283cc-cb12-4213-8ee1-fbd6e1ae2426 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:16.754074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:16.754719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:16.754981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:16.755247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] PATH_INFO: `/v3/users/3cfe1ba481414a809966192b4f1d9e4a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:16.756351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfe1ba481414a809966192b4f1d9e4a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:16.758502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:16.806856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:16.808406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:16.821782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfe1ba481414a809966192b4f1d9e4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.831759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfe1ba481414a809966192b4f1d9e4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.840421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b404-a397-4ec5-83d9-703ff20aafff admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:16.845561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:16.846202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:16.846482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:16.846758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] PATH_INFO: `/v3/projects/bbcafbf24d9d458b99100ba7e2c853ef` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:16.847890 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcafbf24d9d458b99100ba7e2c853ef)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:16.848172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfe1ba481414a809966192b4f1d9e4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.848911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfe1ba481414a809966192b4f1d9e4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.849882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:16.850257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:16.858613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f070830e-2cd7-4d5f-a56f-f4b04b2cb2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfe1ba481414a809966192b4f1d9e4a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.865610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1160/2335] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:16 2022] DELETE /identity/v3/users/3cfe1ba481414a809966192b4f1d9e4a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:16.870527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b66c7-67dd-48b6-a1bd-bf1e4ed177b3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:16.871032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b66c7-67dd-48b6-a1bd-bf1e4ed177b3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:16.871313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b66c7-67dd-48b6-a1bd-bf1e4ed177b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:16.891454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9f6b66c7-67dd-48b6-a1bd-bf1e4ed177b3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:16.892699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9f6b66c7-67dd-48b6-a1bd-bf1e4ed177b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:16.902201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcafbf24d9d458b99100ba7e2c853ef', 'request_id': 'req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.915161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcafbf24d9d458b99100ba7e2c853ef', 'request_id': 'req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.932135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcafbf24d9d458b99100ba7e2c853ef', 'request_id': 'req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.950760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] The token cache is being invalidate because project bbcafbf24d9d458b99100ba7e2c853ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:16.951343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.952152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:16.955131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1176/2336] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:16 2022] DELETE /identity/v3/projects/bbcafbf24d9d458b99100ba7e2c853ef => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:16.961048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:16.962603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:16.969820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1161/2337] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:16.976978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4ffdb-a6b6-41ab-b09b-96d0d5b8c1e2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:16.980830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b66c7-67dd-48b6-a1bd-bf1e4ed177b3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:16.982972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9f6b66c7-67dd-48b6-a1bd-bf1e4ed177b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:16.986410 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:16.987371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:16.987829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:16.988269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] PATH_INFO: `/v3/users/a33061a869404e959bc5a82592e230d3` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:16.989696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33061a869404e959bc5a82592e230d3)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:16.992155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:17.054941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33061a869404e959bc5a82592e230d3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.076223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33061a869404e959bc5a82592e230d3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.095159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33061a869404e959bc5a82592e230d3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.096185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33061a869404e959bc5a82592e230d3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.105246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33061a869404e959bc5a82592e230d3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.110026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b66c7-67dd-48b6-a1bd-bf1e4ed177b3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:17.113814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1177/2338] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:16 2022] DELETE /identity/v3/users/a33061a869404e959bc5a82592e230d3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:17.115045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:17.115678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:17.115960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:17.116265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:17.118204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:17.133861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:17.135321 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:17.149132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1162/2339] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:17.552566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:17.555189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:17.645523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=3,keystone:DELETE=18,keystone:SELECT=79 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:17.654100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:17.656013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:17.672025 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e191f-6c9e-475e-aacb-4dad709008fd service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:17.677644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:17.678306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:17.678600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:17.679396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] PATH_INFO: `/v3/projects/23bc87a9d7b2420aa09568f20fc2a5f8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:17.680759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bc87a9d7b2420aa09568f20fc2a5f8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:17.683103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:17.683454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cb165-362e-4454-9820-0508abf747b4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:17.688657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:17.689384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:17.689751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:17.690108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] PATH_INFO: `/v3/projects/72eac69d22e54e28b5aad41b05042ffd` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:17.691297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72eac69d22e54e28b5aad41b05042ffd)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:17.693260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:17.763285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bc87a9d7b2420aa09568f20fc2a5f8', 'request_id': 'req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.765893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72eac69d22e54e28b5aad41b05042ffd', 'request_id': 'req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.769330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bc87a9d7b2420aa09568f20fc2a5f8', 'request_id': 'req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.776395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72eac69d22e54e28b5aad41b05042ffd', 'request_id': 'req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.777810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bc87a9d7b2420aa09568f20fc2a5f8', 'request_id': 'req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.784623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72eac69d22e54e28b5aad41b05042ffd', 'request_id': 'req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.798630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] The token cache is being invalidate because project 72eac69d22e54e28b5aad41b05042ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:17.799073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.800354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.801657 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] The token cache is being invalidate because project 23bc87a9d7b2420aa09568f20fc2a5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:17.801960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.805359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1178/2340] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:17 2022] DELETE /identity/v3/projects/72eac69d22e54e28b5aad41b05042ffd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:17.805528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6cfbf86-558d-4f6b-b33a-5ea63fed2833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.805528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1163/2341] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:17 2022] DELETE /identity/v3/projects/23bc87a9d7b2420aa09568f20fc2a5f8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:17.806438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:17.811093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:17.811457 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9389-5403-42e8-b18f-b9a6e5139833 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:17.811758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9389-5403-42e8-b18f-b9a6e5139833 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:17.812037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9389-5403-42e8-b18f-b9a6e5139833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:17.841361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a68e9389-5403-42e8-b18f-b9a6e5139833 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:17.842797 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a68e9389-5403-42e8-b18f-b9a6e5139833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:17.855565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:17.895888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c4e1-c8f5-4492-92d9-5beff54f43c6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:17.901333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:17.901979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:17.902269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:17.902541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] PATH_INFO: `/v3/users/147dc136aa524ca3b9e039c2a5eb3811` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:17.903665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147dc136aa524ca3b9e039c2a5eb3811)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:17.905610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:17.921159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1164/2342] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:17.929568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa561e60-aef3-45dd-8ba7-85834122ebcf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:17.929829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa561e60-aef3-45dd-8ba7-85834122ebcf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:17.930245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa561e60-aef3-45dd-8ba7-85834122ebcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:17.953950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fa561e60-aef3-45dd-8ba7-85834122ebcf None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:17.955266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fa561e60-aef3-45dd-8ba7-85834122ebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:17.964723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1165/2343] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:17.968463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa561e60-aef3-45dd-8ba7-85834122ebcf None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:17.973297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147dc136aa524ca3b9e039c2a5eb3811'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.978111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa561e60-aef3-45dd-8ba7-85834122ebcf None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:17.983913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:17.984294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:17.984658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:17.984995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:17.985812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:17.986283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:17.987939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:17.988581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147dc136aa524ca3b9e039c2a5eb3811'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:17.994025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:17.999889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147dc136aa524ca3b9e039c2a5eb3811'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.000818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147dc136aa524ca3b9e039c2a5eb3811'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.005497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1166/2344] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:15:18.010093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.011604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147dc136aa524ca3b9e039c2a5eb3811'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.012120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.019083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1179/2345] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:17 2022] DELETE /identity/v3/users/147dc136aa524ca3b9e039c2a5eb3811 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:18.032953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced7b2-6972-4034-97d9-6607f20f9cf9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.102504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89cc2c-b4f1-4e0e-bc3e-7f87185a0b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.103123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89cc2c-b4f1-4e0e-bc3e-7f87185a0b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.103402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89cc2c-b4f1-4e0e-bc3e-7f87185a0b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.103668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89cc2c-b4f1-4e0e-bc3e-7f87185a0b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.104301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89cc2c-b4f1-4e0e-bc3e-7f87185a0b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.106308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89cc2c-b4f1-4e0e-bc3e-7f87185a0b44 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.142144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1167/2346] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:18 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:18.143294 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.155249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720771d-c46a-439f-803e-020854f125e7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.236115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37669e48-f5e3-4f9b-a2c3-80b2bbe91aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.236732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669e48-f5e3-4f9b-a2c3-80b2bbe91aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.237039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669e48-f5e3-4f9b-a2c3-80b2bbe91aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.237333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669e48-f5e3-4f9b-a2c3-80b2bbe91aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.238056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37669e48-f5e3-4f9b-a2c3-80b2bbe91aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.239986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37669e48-f5e3-4f9b-a2c3-80b2bbe91aa8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.267019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1180/2347] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:18 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:18.268192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89cc2c-b4f1-4e0e-bc3e-7f87185a0b44 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.278748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89cc2c-b4f1-4e0e-bc3e-7f87185a0b44 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.283419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.284094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.284380 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.284658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.285338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.287147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.298360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1168/2348] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:18.302522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37669e48-f5e3-4f9b-a2c3-80b2bbe91aa8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.314044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37669e48-f5e3-4f9b-a2c3-80b2bbe91aa8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.314272 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.316048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.318835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107f4e8-e5af-44c9-ab88-fba8e11603cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.319478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107f4e8-e5af-44c9-ab88-fba8e11603cd admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.319764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107f4e8-e5af-44c9-ab88-fba8e11603cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.320032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107f4e8-e5af-44c9-ab88-fba8e11603cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.320682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107f4e8-e5af-44c9-ab88-fba8e11603cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.322327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107f4e8-e5af-44c9-ab88-fba8e11603cd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.333621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1181/2349] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:18.336715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ac2d8-51b8-4e8e-966f-beca47ab2ce7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.342812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.343465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.343747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.344022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] PATH_INFO: `/v3/projects/b56ed12124474db898e4ef5a911158f5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.345357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107f4e8-e5af-44c9-ab88-fba8e11603cd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.345817 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56ed12124474db898e4ef5a911158f5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.347748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.359983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107f4e8-e5af-44c9-ab88-fba8e11603cd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.365628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e73088-fa2d-4ba5-9a11-1d006f84daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.366876 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73088-fa2d-4ba5-9a11-1d006f84daa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.367185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73088-fa2d-4ba5-9a11-1d006f84daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.367403 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73088-fa2d-4ba5-9a11-1d006f84daa2 admin admin] PATH_INFO: `/v3/projects/2ed335a7dadb4b0aac11257767ea3b70/users/46ce816d3bda48049f6bb65602c75f61/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.384750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e73088-fa2d-4ba5-9a11-1d006f84daa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed335a7dadb4b0aac11257767ea3b70, user_id=46ce816d3bda48049f6bb65602c75f61, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.387594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e73088-fa2d-4ba5-9a11-1d006f84daa2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.403223 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1182/2350] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:18 2022] PUT /identity/v3/projects/2ed335a7dadb4b0aac11257767ea3b70/users/46ce816d3bda48049f6bb65602c75f61/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:18.414750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0871-5e17-4ad5-b0fb-2dc979241a34 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.415198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0871-5e17-4ad5-b0fb-2dc979241a34 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.415475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a0871-5e17-4ad5-b0fb-2dc979241a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.416329 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56ed12124474db898e4ef5a911158f5', 'request_id': 'req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.423438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56ed12124474db898e4ef5a911158f5', 'request_id': 'req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.431713 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56ed12124474db898e4ef5a911158f5', 'request_id': 'req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.435501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:18.449388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] The token cache is being invalidate because project b56ed12124474db898e4ef5a911158f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:18.450225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.450406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-990a0871-5e17-4ad5-b0fb-2dc979241a34 None None] MFA Rules not processed for user `46ce816d3bda48049f6bb65602c75f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:18.451471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3e8d0cb3-38a9-4cf4-ac87-2343376edf18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.451672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-990a0871-5e17-4ad5-b0fb-2dc979241a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.453628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1169/2351] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:18 2022] DELETE /identity/v3/projects/b56ed12124474db898e4ef5a911158f5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:18.459048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d397c-6ede-4e0f-ba86-600290b4de24 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.459331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d397c-6ede-4e0f-ba86-600290b4de24 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.459608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d397c-6ede-4e0f-ba86-600290b4de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.482126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-517d397c-6ede-4e0f-ba86-600290b4de24 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:18.483347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-517d397c-6ede-4e0f-ba86-600290b4de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.565424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1183/2352] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:18.577533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1170/2353] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:18.582512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a0871-5e17-4ad5-b0fb-2dc979241a34 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.584172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-990a0871-5e17-4ad5-b0fb-2dc979241a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.584858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01481-127d-4413-a1c5-b065011deb90 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.585187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01481-127d-4413-a1c5-b065011deb90 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.585551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01481-127d-4413-a1c5-b065011deb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.609185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-44f01481-127d-4413-a1c5-b065011deb90 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:18.610590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-44f01481-127d-4413-a1c5-b065011deb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.623512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1171/2354] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:18.623743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:18.624510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f01481-127d-4413-a1c5-b065011deb90 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.635560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f01481-127d-4413-a1c5-b065011deb90 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.642883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.644267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.644552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.645021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.645784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:18.647722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.649385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.653660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a0871-5e17-4ad5-b0fb-2dc979241a34 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.658095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.658708 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.658993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.659267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.662642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1172/2355] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:15:18.666868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.673316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.675712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.678584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ac46f-d832-496e-9662-806b82fd308d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.686087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e78249-eb74-414c-9267-82c06256b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.686833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e78249-eb74-414c-9267-82c06256b699 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.687121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e78249-eb74-414c-9267-82c06256b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.687396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e78249-eb74-414c-9267-82c06256b699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.688037 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e78249-eb74-414c-9267-82c06256b699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.690789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e78249-eb74-414c-9267-82c06256b699 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.698239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1184/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:18.725561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.727293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.747677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1173/2357] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:18 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:18.748519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ecf73-c779-40a8-a8ce-e19cdbe3ce20 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.750081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e78249-eb74-414c-9267-82c06256b699 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.823273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e78249-eb74-414c-9267-82c06256b699 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.825594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.826433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.826724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.827002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] PATH_INFO: `/v3/users/46ce816d3bda48049f6bb65602c75f61` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.828139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ce816d3bda48049f6bb65602c75f61)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.829468 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb6c5-d40c-4b7b-b6c9-1f0441f1239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.830195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.830604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb6c5-d40c-4b7b-b6c9-1f0441f1239c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.831192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb6c5-d40c-4b7b-b6c9-1f0441f1239c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.831613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb6c5-d40c-4b7b-b6c9-1f0441f1239c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.832618 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccb6c5-d40c-4b7b-b6c9-1f0441f1239c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.834754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccb6c5-d40c-4b7b-b6c9-1f0441f1239c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.884322 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1174/2358] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:18 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:18.886955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb6c5-d40c-4b7b-b6c9-1f0441f1239c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.889900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ce816d3bda48049f6bb65602c75f61'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.906531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb6c5-d40c-4b7b-b6c9-1f0441f1239c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.906531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:18.906531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.906531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.906877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.908865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ce816d3bda48049f6bb65602c75f61'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.909671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:18.911649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:18.919933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ce816d3bda48049f6bb65602c75f61'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.921298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ce816d3bda48049f6bb65602c75f61'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.931210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1175/2359] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:15:18.935434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9d988aea-dbd8-44a4-8295-de19d9d96ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ce816d3bda48049f6bb65602c75f61'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:18.935742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:18.939477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.946580 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1185/2360] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:18 2022] DELETE /identity/v3/users/46ce816d3bda48049f6bb65602c75f61 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:18.948248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0255e8-7db5-4dfc-ab5b-3926284956b9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:18.948802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0255e8-7db5-4dfc-ab5b-3926284956b9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:18.949155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0255e8-7db5-4dfc-ab5b-3926284956b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:18.958202 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02defb-7eb4-44ba-8ded-6505ddc48144 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:18.972938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ed0255e8-7db5-4dfc-ab5b-3926284956b9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:18.974500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed0255e8-7db5-4dfc-ab5b-3926284956b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:18.998230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:19.043481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:19.049998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fd46c-5b72-4cf2-a18c-e18696e2d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:19.050722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fd46c-5b72-4cf2-a18c-e18696e2d685 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:19.051006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fd46c-5b72-4cf2-a18c-e18696e2d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:19.051328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fd46c-5b72-4cf2-a18c-e18696e2d685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:19.052352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fd46c-5b72-4cf2-a18c-e18696e2d685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:19.054718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fd46c-5b72-4cf2-a18c-e18696e2d685 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:19.062167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1186/2361] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:19.070120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1176/2362] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:19.071459 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0255e8-7db5-4dfc-ab5b-3926284956b9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:19.071753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fd46c-5b72-4cf2-a18c-e18696e2d685 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:19.072980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed0255e8-7db5-4dfc-ab5b-3926284956b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:19.082894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fd46c-5b72-4cf2-a18c-e18696e2d685 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:19.089855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1b5b-2be4-4dc9-82fe-c6436bb8d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:19.092818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1b5b-2be4-4dc9-82fe-c6436bb8d984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:19.093117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1b5b-2be4-4dc9-82fe-c6436bb8d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:19.093460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1b5b-2be4-4dc9-82fe-c6436bb8d984 admin admin] PATH_INFO: `/v3/projects/4b8221e3cb2745839718045373bc7f30/users/4ea377d855a74df2bd0f0fee4f8b9ce4/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:19.110139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc1b5b-2be4-4dc9-82fe-c6436bb8d984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8221e3cb2745839718045373bc7f30, user_id=4ea377d855a74df2bd0f0fee4f8b9ce4, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:19.112799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc1b5b-2be4-4dc9-82fe-c6436bb8d984 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:19.129889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1177/2363] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:19 2022] PUT /identity/v3/projects/4b8221e3cb2745839718045373bc7f30/users/4ea377d855a74df2bd0f0fee4f8b9ce4/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:19.142116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0772c6-cc1f-4e02-857e-8b4396116dd1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:19.142305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0772c6-cc1f-4e02-857e-8b4396116dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:19.142693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0772c6-cc1f-4e02-857e-8b4396116dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:19.145793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0255e8-7db5-4dfc-ab5b-3926284956b9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:19.177874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ce0772c6-cc1f-4e02-857e-8b4396116dd1 None None] MFA Rules not processed for user `4ea377d855a74df2bd0f0fee4f8b9ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:19.180006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ce0772c6-cc1f-4e02-857e-8b4396116dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:19.226093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:19.226093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:19.226093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:19.226093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:19.288143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1178/2364] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:19.297038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0772c6-cc1f-4e02-857e-8b4396116dd1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:19.298842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ce0772c6-cc1f-4e02-857e-8b4396116dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:19.336457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:19.342514 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:19.356293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1187/2365] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:15:19.382110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0772c6-cc1f-4e02-857e-8b4396116dd1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:19.387304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e472707-875d-4ae3-9417-1f4401b7f63b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:19.387985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472707-875d-4ae3-9417-1f4401b7f63b service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:19.388270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472707-875d-4ae3-9417-1f4401b7f63b service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:19.388590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e472707-875d-4ae3-9417-1f4401b7f63b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:19.409768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e472707-875d-4ae3-9417-1f4401b7f63b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:19.412942 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e472707-875d-4ae3-9417-1f4401b7f63b service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:19.427913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1179/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:15:19.797673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:19.799486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:19.832838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14a9b9-6c4c-463f-a85f-cf7b5ceb7305 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:19.842069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:19.842785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:19.843168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:19.843546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] PATH_INFO: `/v3/projects/2ed335a7dadb4b0aac11257767ea3b70` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:19.845090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed335a7dadb4b0aac11257767ea3b70)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:19.847473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:19.925625 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed335a7dadb4b0aac11257767ea3b70', 'request_id': 'req-39f01f60-3422-4a7e-91a1-906a02c0c52c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:19.934010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:19.938056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed335a7dadb4b0aac11257767ea3b70', 'request_id': 'req-39f01f60-3422-4a7e-91a1-906a02c0c52c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:19.945375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed335a7dadb4b0aac11257767ea3b70', 'request_id': 'req-39f01f60-3422-4a7e-91a1-906a02c0c52c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:19.959048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] The token cache is being invalidate because project 2ed335a7dadb4b0aac11257767ea3b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:19.959350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:19.960675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-39f01f60-3422-4a7e-91a1-906a02c0c52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:19.965461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1188/2367] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:19 2022] DELETE /identity/v3/projects/2ed335a7dadb4b0aac11257767ea3b70 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:19.967189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ecd0e-546f-45b6-8f6e-d1e79ef87c2d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:19.967664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ecd0e-546f-45b6-8f6e-d1e79ef87c2d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:19.967746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ecd0e-546f-45b6-8f6e-d1e79ef87c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:19.993383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0f2ecd0e-546f-45b6-8f6e-d1e79ef87c2d None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:19.994631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0f2ecd0e-546f-45b6-8f6e-d1e79ef87c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:20.026168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:20.058751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1180/2368] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:20.067486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7947-248b-4793-87e5-09ec2bfaf57f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.068198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7947-248b-4793-87e5-09ec2bfaf57f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.068198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7947-248b-4793-87e5-09ec2bfaf57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.091706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-656d7947-248b-4793-87e5-09ec2bfaf57f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:20.092955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-656d7947-248b-4793-87e5-09ec2bfaf57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:20.102092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1189/2369] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:15:20.106447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ecd0e-546f-45b6-8f6e-d1e79ef87c2d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.117060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ecd0e-546f-45b6-8f6e-d1e79ef87c2d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:20.121894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:20.122645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.122931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.123198 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.123863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:20.124165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:20.125834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:20.139571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1181/2370] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:15:20.144038 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d7947-248b-4793-87e5-09ec2bfaf57f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.154275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d7947-248b-4793-87e5-09ec2bfaf57f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:20.159267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c4b62-2ff0-48ed-a085-a5808da2c66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:20.159895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c4b62-2ff0-48ed-a085-a5808da2c66f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.160172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c4b62-2ff0-48ed-a085-a5808da2c66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.160440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c4b62-2ff0-48ed-a085-a5808da2c66f admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.161096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c4b62-2ff0-48ed-a085-a5808da2c66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:20.163705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c4b62-2ff0-48ed-a085-a5808da2c66f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:20.196708 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1190/2371] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:20 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:20.197928 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.208489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7591-a1d6-4055-b515-1aad890da0c5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:20.270295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826365-efad-4495-8ee4-98134d71bbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:20.270913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826365-efad-4495-8ee4-98134d71bbde admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.271243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826365-efad-4495-8ee4-98134d71bbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.271517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826365-efad-4495-8ee4-98134d71bbde admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.272164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f826365-efad-4495-8ee4-98134d71bbde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:20.274630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f826365-efad-4495-8ee4-98134d71bbde admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:20.296528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1182/2372] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:20 2022] POST /identity/v3/users => generated 280 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:15:20.301228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c4b62-2ff0-48ed-a085-a5808da2c66f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.311907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c4b62-2ff0-48ed-a085-a5808da2c66f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:20.316510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b567d-4096-40a4-81b6-75a5cfefb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:20.317103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b567d-4096-40a4-81b6-75a5cfefb760 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.317381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b567d-4096-40a4-81b6-75a5cfefb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.317688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b567d-4096-40a4-81b6-75a5cfefb760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.318327 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b567d-4096-40a4-81b6-75a5cfefb760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:20.320455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b567d-4096-40a4-81b6-75a5cfefb760 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:20.330561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1191/2373] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:20.334867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826365-efad-4495-8ee4-98134d71bbde admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.346299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826365-efad-4495-8ee4-98134d71bbde admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:20.351284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfd81f-f785-49c8-a86f-e66634a0f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:20.351929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd81f-f785-49c8-a86f-e66634a0f66e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.352222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd81f-f785-49c8-a86f-e66634a0f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.352514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfd81f-f785-49c8-a86f-e66634a0f66e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.353152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfd81f-f785-49c8-a86f-e66634a0f66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:20.354819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfd81f-f785-49c8-a86f-e66634a0f66e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:20.365671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1183/2374] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:15:20.370100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b567d-4096-40a4-81b6-75a5cfefb760 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.381462 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b567d-4096-40a4-81b6-75a5cfefb760 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:20.386625 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:20.387436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.387697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.387970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] PATH_INFO: `/v3/projects/101147ba5d0f4640834342b9dcbd1608/users/0eedfee9d53b4682987082202c0ce147/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.402898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101147ba5d0f4640834342b9dcbd1608, user_id=0eedfee9d53b4682987082202c0ce147, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:20.405572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:20.418613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1192/2375] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:20 2022] PUT /identity/v3/projects/101147ba5d0f4640834342b9dcbd1608/users/0eedfee9d53b4682987082202c0ce147/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:20.428718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b20d06-f878-4302-a083-de18d88890ec None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.429013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b20d06-f878-4302-a083-de18d88890ec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.429345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b20d06-f878-4302-a083-de18d88890ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.457326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-12b20d06-f878-4302-a083-de18d88890ec None None] MFA Rules not processed for user `0eedfee9d53b4682987082202c0ce147`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:20.458497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-12b20d06-f878-4302-a083-de18d88890ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:20.535568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1184/2376] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:20.570780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.572585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:20.630809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1d5fd-4470-4fe2-b6ba-e077e8531e14 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:20.635945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf666b-eb3f-4ccb-853a-d1cc4b277f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:20.636746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf666b-eb3f-4ccb-853a-d1cc4b277f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.637029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf666b-eb3f-4ccb-853a-d1cc4b277f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.637472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf666b-eb3f-4ccb-853a-d1cc4b277f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.647858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf666b-eb3f-4ccb-853a-d1cc4b277f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:20.649552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf666b-eb3f-4ccb-853a-d1cc4b277f0a service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:20.659083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1193/2377] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:20.674724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b20d06-f878-4302-a083-de18d88890ec None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.714284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:20.746826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b20d06-f878-4302-a083-de18d88890ec None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:20.751448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:20.752074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.752355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.752630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] PATH_INFO: `/v3/users/0eedfee9d53b4682987082202c0ce147` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.754073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eedfee9d53b4682987082202c0ce147)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:20.755985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:20.801105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eedfee9d53b4682987082202c0ce147'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:20.808576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eedfee9d53b4682987082202c0ce147'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:20.820696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eedfee9d53b4682987082202c0ce147'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:20.821335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eedfee9d53b4682987082202c0ce147'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:20.828275 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eedfee9d53b4682987082202c0ce147'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:20.837916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1185/2378] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:20 2022] DELETE /identity/v3/users/0eedfee9d53b4682987082202c0ce147 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:20.839404 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e39a-ebf3-47ee-9bd8-938bb6bc79f8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:20.839791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e39a-ebf3-47ee-9bd8-938bb6bc79f8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:20.839956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e39a-ebf3-47ee-9bd8-938bb6bc79f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:20.859355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9198e39a-ebf3-47ee-9bd8-938bb6bc79f8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:20.860613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9198e39a-ebf3-47ee-9bd8-938bb6bc79f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:20.931941 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1194/2379] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:20.943552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:20.945819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:21.022987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b0678-e01e-4e2a-8734-c7c5eb83796d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:21.030434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa82d23-c278-4190-b022-9ff5b740d3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:21.031151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82d23-c278-4190-b022-9ff5b740d3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:21.031506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82d23-c278-4190-b022-9ff5b740d3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:21.031847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82d23-c278-4190-b022-9ff5b740d3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:21.042528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa82d23-c278-4190-b022-9ff5b740d3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:21.044061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa82d23-c278-4190-b022-9ff5b740d3e7 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:21.055445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1186/2380] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:21.509691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198e39a-ebf3-47ee-9bd8-938bb6bc79f8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:21.511900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9198e39a-ebf3-47ee-9bd8-938bb6bc79f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:21.535934 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198e39a-ebf3-47ee-9bd8-938bb6bc79f8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:21.546367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:21.547024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:21.547306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:21.547612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] PATH_INFO: `/v3/projects/101147ba5d0f4640834342b9dcbd1608` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:21.555140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=101147ba5d0f4640834342b9dcbd1608)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:21.557735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:21.582692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:21.632764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101147ba5d0f4640834342b9dcbd1608', 'request_id': 'req-1ac51306-6027-4a83-830b-734fbda55179'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:21.644995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101147ba5d0f4640834342b9dcbd1608', 'request_id': 'req-1ac51306-6027-4a83-830b-734fbda55179'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:21.654115 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101147ba5d0f4640834342b9dcbd1608', 'request_id': 'req-1ac51306-6027-4a83-830b-734fbda55179'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:21.668561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] The token cache is being invalidate because project 101147ba5d0f4640834342b9dcbd1608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:21.668869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:21.669942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ac51306-6027-4a83-830b-734fbda55179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:21.674812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1195/2381] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:21 2022] DELETE /identity/v3/projects/101147ba5d0f4640834342b9dcbd1608 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:21.676526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d375b-b3ae-456d-82d5-7e521abc2c38 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:21.676918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d375b-b3ae-456d-82d5-7e521abc2c38 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:21.677112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d375b-b3ae-456d-82d5-7e521abc2c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:21.700802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-305d375b-b3ae-456d-82d5-7e521abc2c38 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:21.703069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-305d375b-b3ae-456d-82d5-7e521abc2c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:21.764103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:21.793868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1187/2382] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:21.793956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4500-aff6-4c49-984c-2eb0db5502b1 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:21.793956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4500-aff6-4c49-984c-2eb0db5502b1 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:21.793956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4500-aff6-4c49-984c-2eb0db5502b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:21.815486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-308c4500-aff6-4c49-984c-2eb0db5502b1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:21.816720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-308c4500-aff6-4c49-984c-2eb0db5502b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:21.831052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1196/2383] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:21.831775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d375b-b3ae-456d-82d5-7e521abc2c38 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:21.842698 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d375b-b3ae-456d-82d5-7e521abc2c38 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:21.848126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:21.848739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:21.849156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:21.849352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:21.851103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:21.851526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:21.853133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:21.868402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1188/2384] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:15:21.872852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c4500-aff6-4c49-984c-2eb0db5502b1 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:21.882879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c4500-aff6-4c49-984c-2eb0db5502b1 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:21.887691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8781f6a-3b16-4c13-88a7-4eab12360cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:21.888329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781f6a-3b16-4c13-88a7-4eab12360cca admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:21.888609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781f6a-3b16-4c13-88a7-4eab12360cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:21.888881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781f6a-3b16-4c13-88a7-4eab12360cca admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:21.889726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8781f6a-3b16-4c13-88a7-4eab12360cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:21.891703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8781f6a-3b16-4c13-88a7-4eab12360cca admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:21.920157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1197/2385] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:21 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:21.924223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:21.936345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14fd2a-fe86-43db-8a94-689d6d800b12 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:21.994472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ad79-ceff-4004-a3ae-1c090c59feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:21.994999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ad79-ceff-4004-a3ae-1c090c59feb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:21.995280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ad79-ceff-4004-a3ae-1c090c59feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:21.995551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ad79-ceff-4004-a3ae-1c090c59feb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:21.996187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2ad79-ceff-4004-a3ae-1c090c59feb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:21.998140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2ad79-ceff-4004-a3ae-1c090c59feb9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:22.019567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1189/2386] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:21 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:22.023771 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8781f6a-3b16-4c13-88a7-4eab12360cca admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:22.034644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8781f6a-3b16-4c13-88a7-4eab12360cca admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:22.040175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1dc93-6f4a-473c-a91b-1669055b7a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:22.040799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1dc93-6f4a-473c-a91b-1669055b7a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:22.041117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1dc93-6f4a-473c-a91b-1669055b7a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:22.041435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1dc93-6f4a-473c-a91b-1669055b7a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:22.042121 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1dc93-6f4a-473c-a91b-1669055b7a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:22.043898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1dc93-6f4a-473c-a91b-1669055b7a4d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:22.055786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1198/2387] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:22.059974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ad79-ceff-4004-a3ae-1c090c59feb9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:22.071420 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ad79-ceff-4004-a3ae-1c090c59feb9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:22.076484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5872f-7fdd-4fe6-a2c3-ebc8cb34b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:22.077103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5872f-7fdd-4fe6-a2c3-ebc8cb34b259 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:22.077384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5872f-7fdd-4fe6-a2c3-ebc8cb34b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:22.077701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5872f-7fdd-4fe6-a2c3-ebc8cb34b259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:22.078506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5872f-7fdd-4fe6-a2c3-ebc8cb34b259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:22.080241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5872f-7fdd-4fe6-a2c3-ebc8cb34b259 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:22.092271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1190/2388] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:15:22.096865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1dc93-6f4a-473c-a91b-1669055b7a4d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:22.109136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1dc93-6f4a-473c-a91b-1669055b7a4d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:22.113823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:22.114472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:22.114754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:22.115024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] PATH_INFO: `/v3/projects/4e25596e0ea643328064ec0718dedccd/users/0921bd12cf52483689e1d1aec39155aa/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:22.130803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e25596e0ea643328064ec0718dedccd, user_id=0921bd12cf52483689e1d1aec39155aa, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:22.133523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:22.147818 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1199/2389] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:22 2022] PUT /identity/v3/projects/4e25596e0ea643328064ec0718dedccd/users/0921bd12cf52483689e1d1aec39155aa/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:22.152761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337dd6-91d4-4367-b4b0-ffb72fc3176e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:22.153044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337dd6-91d4-4367-b4b0-ffb72fc3176e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:22.153314 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337dd6-91d4-4367-b4b0-ffb72fc3176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:22.172777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-13337dd6-91d4-4367-b4b0-ffb72fc3176e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:22.174011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-13337dd6-91d4-4367-b4b0-ffb72fc3176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:22.239532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1191/2390] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:22.250191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:22.252057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:22.312896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc5dcc-60d5-470a-8f34-443d15f438b6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:22.316606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf0822-5f15-4c28-9087-8276d481bea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:22.317216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0822-5f15-4c28-9087-8276d481bea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:22.317617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0822-5f15-4c28-9087-8276d481bea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:22.317893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0822-5f15-4c28-9087-8276d481bea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:22.327072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf0822-5f15-4c28-9087-8276d481bea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:22.328517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf0822-5f15-4c28-9087-8276d481bea5 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:22.338961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1200/2391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:15:22.822213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13337dd6-91d4-4367-b4b0-ffb72fc3176e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:22.823683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-13337dd6-91d4-4367-b4b0-ffb72fc3176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:22.836277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13337dd6-91d4-4367-b4b0-ffb72fc3176e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:22.840999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:22.841762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:22.842109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:22.842709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] PATH_INFO: `/v3/users/4ea377d855a74df2bd0f0fee4f8b9ce4` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:22.843614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea377d855a74df2bd0f0fee4f8b9ce4)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:22.845643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:22.929155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea377d855a74df2bd0f0fee4f8b9ce4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:22.952048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea377d855a74df2bd0f0fee4f8b9ce4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:22.953951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:22.981790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea377d855a74df2bd0f0fee4f8b9ce4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:22.982846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea377d855a74df2bd0f0fee4f8b9ce4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:23.008370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea377d855a74df2bd0f0fee4f8b9ce4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:23.022132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1192/2392] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:22 2022] DELETE /identity/v3/users/4ea377d855a74df2bd0f0fee4f8b9ce4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:23.028861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09011-21c8-4868-be49-60cbc3564dcf None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:23.029448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09011-21c8-4868-be49-60cbc3564dcf None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:23.029448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09011-21c8-4868-be49-60cbc3564dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:23.067805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b9a09011-21c8-4868-be49-60cbc3564dcf None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:23.069317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b9a09011-21c8-4868-be49-60cbc3564dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:23.119528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:23.148750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1201/2393] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:23.173607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:23.173607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:23.226426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6c049-9931-4ddd-ae22-e2f0411c8371 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:23.230049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:23.230670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:23.230956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:23.231227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:23.240882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:23.242956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:23.257384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1193/2394] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:23.581692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f671c5-398a-4dab-aab5-07d5a73d0322 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:23.582221 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f671c5-398a-4dab-aab5-07d5a73d0322 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:23.582644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f671c5-398a-4dab-aab5-07d5a73d0322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:23.626729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-29f671c5-398a-4dab-aab5-07d5a73d0322 None None] MFA Rules not processed for user `0921bd12cf52483689e1d1aec39155aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:23.627956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-29f671c5-398a-4dab-aab5-07d5a73d0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:23.725443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1202/2395] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:23.735731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:23.737136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:23.739542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f671c5-398a-4dab-aab5-07d5a73d0322 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:23.743423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-29f671c5-398a-4dab-aab5-07d5a73d0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:23.775815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f671c5-398a-4dab-aab5-07d5a73d0322 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:23.789957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:23.790926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:23.791752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:23.792732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] PATH_INFO: `/v3/projects/4b8221e3cb2745839718045373bc7f30` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:23.794097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8221e3cb2745839718045373bc7f30)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:23.796136 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:23.828557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c144d1-e42c-4229-a7fa-baac08134fae service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:23.836724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5aed-cfea-495f-b2e3-5119e66f0c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:23.836724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5aed-cfea-495f-b2e3-5119e66f0c63 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:23.836724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5aed-cfea-495f-b2e3-5119e66f0c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:23.837024 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5aed-cfea-495f-b2e3-5119e66f0c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:23.854439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5aed-cfea-495f-b2e3-5119e66f0c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:23.856855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5aed-cfea-495f-b2e3-5119e66f0c63 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:23.860465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8221e3cb2745839718045373bc7f30', 'request_id': 'req-413f16f5-d7d6-4ed4-821d-de43d45c253f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:23.869210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8221e3cb2745839718045373bc7f30', 'request_id': 'req-413f16f5-d7d6-4ed4-821d-de43d45c253f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:23.872872 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1194/2396] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:23.880241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8221e3cb2745839718045373bc7f30', 'request_id': 'req-413f16f5-d7d6-4ed4-821d-de43d45c253f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:23.898113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] The token cache is being invalidate because project 4b8221e3cb2745839718045373bc7f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:23.898406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:23.899259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-413f16f5-d7d6-4ed4-821d-de43d45c253f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:23.900996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1203/2397] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:23 2022] DELETE /identity/v3/projects/4b8221e3cb2745839718045373bc7f30 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:23.907148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956dd76-3a2f-43b5-8211-a6064299eab4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:23.907434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956dd76-3a2f-43b5-8211-a6064299eab4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:23.907702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956dd76-3a2f-43b5-8211-a6064299eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:23.958825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6956dd76-3a2f-43b5-8211-a6064299eab4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:23.960229 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6956dd76-3a2f-43b5-8211-a6064299eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.024687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1195/2398] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:24.032552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4a20-11aa-4489-b24a-10f9fb39c871 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.033095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4a20-11aa-4489-b24a-10f9fb39c871 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.033273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4a20-11aa-4489-b24a-10f9fb39c871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.062316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-529e4a20-11aa-4489-b24a-10f9fb39c871 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:24.064538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-529e4a20-11aa-4489-b24a-10f9fb39c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.076371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1204/2399] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:24.077885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956dd76-3a2f-43b5-8211-a6064299eab4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.091963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956dd76-3a2f-43b5-8211-a6064299eab4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.097704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.098653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.099083 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.099788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.101165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:15:24.101640 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.107558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.122997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e4a20-11aa-4489-b24a-10f9fb39c871 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.125065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-529e4a20-11aa-4489-b24a-10f9fb39c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.133863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1196/2400] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:15:24.135401 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.146019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e4a20-11aa-4489-b24a-10f9fb39c871 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.146185 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:24.153282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.154772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.155290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.155779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] PATH_INFO: `/v3/users/13ebe5d1da8641b5a5695c904e21273f` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.157577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ebe5d1da8641b5a5695c904e21273f)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.160371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.166556 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e0ca7-b364-4a7d-9cfa-13cabc8b91da admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.179940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b915e0-161c-4a01-9a92-28d485bf2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.180675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b915e0-161c-4a01-9a92-28d485bf2b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.181046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b915e0-161c-4a01-9a92-28d485bf2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.181394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b915e0-161c-4a01-9a92-28d485bf2b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.182194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b915e0-161c-4a01-9a92-28d485bf2b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.184381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b915e0-161c-4a01-9a92-28d485bf2b18 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.230951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1197/2401] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:15:24 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:15:24.232426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b915e0-161c-4a01-9a92-28d485bf2b18 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.262455 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:24.270846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ebe5d1da8641b5a5695c904e21273f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:24.289561 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ebe5d1da8641b5a5695c904e21273f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:24.309996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ebe5d1da8641b5a5695c904e21273f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:24.311435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ebe5d1da8641b5a5695c904e21273f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:24.327841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4b9cd36-0030-4976-a7da-87ddf5141aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ebe5d1da8641b5a5695c904e21273f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:24.348220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1205/2402] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:24 2022] DELETE /identity/v3/users/13ebe5d1da8641b5a5695c904e21273f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:24.350804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b389f-607e-4644-a114-620211bcbfc8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.351174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b389f-607e-4644-a114-620211bcbfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.351439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b389f-607e-4644-a114-620211bcbfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.386066 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-367b389f-607e-4644-a114-620211bcbfc8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:24.388484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-367b389f-607e-4644-a114-620211bcbfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.392332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b915e0-161c-4a01-9a92-28d485bf2b18 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.484833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.485233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1206/2403] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:24.485976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.486486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.486821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.487948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.489597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.499207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b389f-607e-4644-a114-620211bcbfc8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.501616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-367b389f-607e-4644-a114-620211bcbfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.521447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1198/2404] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:15:24 2022] POST /identity/v3/users => generated 284 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:15:24.523750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.530160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.543564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154cdd7-2867-4a76-9c5f-188513e3addd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.549449 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591138a8-5061-4c74-b264-da3f7801be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.550080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591138a8-5061-4c74-b264-da3f7801be8b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.550437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591138a8-5061-4c74-b264-da3f7801be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.550781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591138a8-5061-4c74-b264-da3f7801be8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.551490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591138a8-5061-4c74-b264-da3f7801be8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.553181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591138a8-5061-4c74-b264-da3f7801be8b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.568381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1199/2405] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:15:24.572955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591138a8-5061-4c74-b264-da3f7801be8b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.579984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b389f-607e-4644-a114-620211bcbfc8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.584086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ccd74-63e1-4853-8a72-1efdaf3e874a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.585249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591138a8-5061-4c74-b264-da3f7801be8b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.585376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ccd74-63e1-4853-8a72-1efdaf3e874a service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.585610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ccd74-63e1-4853-8a72-1efdaf3e874a service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.585847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ccd74-63e1-4853-8a72-1efdaf3e874a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.590703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eb4c1-fc7b-4570-a893-7f6f53ac2d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.591389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eb4c1-fc7b-4570-a893-7f6f53ac2d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.591773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eb4c1-fc7b-4570-a893-7f6f53ac2d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.592128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eb4c1-fc7b-4570-a893-7f6f53ac2d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.592849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5eb4c1-fc7b-4570-a893-7f6f53ac2d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.594621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5eb4c1-fc7b-4570-a893-7f6f53ac2d7e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.596186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ccd74-63e1-4853-8a72-1efdaf3e874a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.597639 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ccd74-63e1-4853-8a72-1efdaf3e874a service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.607799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1200/2406] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:15:24.611899 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eb4c1-fc7b-4570-a893-7f6f53ac2d7e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.625445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1207/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:15:24.630214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eb4c1-fc7b-4570-a893-7f6f53ac2d7e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.643596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.644440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.645059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.645384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] PATH_INFO: `/v3/projects/3906e45b8dca486db9678b76fb9aa268/users/3e83dc1ad3f44b7e80b2b891089bf8a0/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.665074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3906e45b8dca486db9678b76fb9aa268, user_id=3e83dc1ad3f44b7e80b2b891089bf8a0, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.668044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.693763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1201/2408] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:15:24 2022] PUT /identity/v3/projects/3906e45b8dca486db9678b76fb9aa268/users/3e83dc1ad3f44b7e80b2b891089bf8a0/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:24.705279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2eeb1-1dd4-459f-99be-38b21c042463 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.705659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2eeb1-1dd4-459f-99be-38b21c042463 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.705962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2eeb1-1dd4-459f-99be-38b21c042463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.740196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7ca2eeb1-1dd4-459f-99be-38b21c042463 None None] MFA Rules not processed for user `3e83dc1ad3f44b7e80b2b891089bf8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:24.741954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7ca2eeb1-1dd4-459f-99be-38b21c042463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.812331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:24.826172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1208/2409] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:24.835635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.837357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.875743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:24.900107 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcecd96-6676-4ce7-b9ef-c3b3d628bcae admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:24.903933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e27f3-0e4f-4cf4-8f95-ce1628cbd48d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d637726e3142e6ba90fa201c764b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:24.904800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e27f3-0e4f-4cf4-8f95-ce1628cbd48d service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:24.905080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e27f3-0e4f-4cf4-8f95-ce1628cbd48d service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:24.905359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e27f3-0e4f-4cf4-8f95-ce1628cbd48d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:24.915523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e27f3-0e4f-4cf4-8f95-ce1628cbd48d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:24.917076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e27f3-0e4f-4cf4-8f95-ce1628cbd48d service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:24.920294 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2eeb1-1dd4-459f-99be-38b21c042463 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:24.922078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7ca2eeb1-1dd4-459f-99be-38b21c042463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:24.929997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1202/2410] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:25.010700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2eeb1-1dd4-459f-99be-38b21c042463 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:25.015806 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:25.016427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:25.016704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:25.016973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] PATH_INFO: `/v3/projects/7dbf8e284b834e5485e2c842791ca4d6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:25.018128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbf8e284b834e5485e2c842791ca4d6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:25.020095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:25.082022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbf8e284b834e5485e2c842791ca4d6', 'request_id': 'req-803e3f27-94de-460e-a794-280abe7b6642'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:25.090466 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbf8e284b834e5485e2c842791ca4d6', 'request_id': 'req-803e3f27-94de-460e-a794-280abe7b6642'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:25.099248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbf8e284b834e5485e2c842791ca4d6', 'request_id': 'req-803e3f27-94de-460e-a794-280abe7b6642'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:25.115444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] The token cache is being invalidate because project 7dbf8e284b834e5485e2c842791ca4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:25.115927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:25.116730 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:25.133439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1209/2411] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:24 2022] DELETE /identity/v3/projects/7dbf8e284b834e5485e2c842791ca4d6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:15:25.476259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda331b4-659d-4d37-9553-6fdc57cf2c77 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:25.476759 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda331b4-659d-4d37-9553-6fdc57cf2c77 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:25.476948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda331b4-659d-4d37-9553-6fdc57cf2c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:25.499595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bda331b4-659d-4d37-9553-6fdc57cf2c77 None None] MFA Rules not processed for user `0921bd12cf52483689e1d1aec39155aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:25.501337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bda331b4-659d-4d37-9553-6fdc57cf2c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:25.568529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1203/2412] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:30.046951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:30.048593 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:30.147259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3f27-94de-460e-a794-280abe7b6642 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:30.150895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:30.151516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:30.151848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:30.152128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:30.155758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:30.221510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:30.262118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:30.264031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:30.276421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1210/2413] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:35.561144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=36 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:37.780652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988532-50ea-414e-9aec-1934a7bdc301 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:37.781247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988532-50ea-414e-9aec-1934a7bdc301 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:37.781357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988532-50ea-414e-9aec-1934a7bdc301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:37.801505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ba988532-50ea-414e-9aec-1934a7bdc301 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:37.802778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba988532-50ea-414e-9aec-1934a7bdc301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:37.865611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1204/2414] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:37.877932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:37.879617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:37.978945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95b1ec-c915-4235-b26e-4311f47ffb8d service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:37.984613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:37.985588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:37.985930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:37.986308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:37.996816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:37.998330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:38.008119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1211/2415] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:15:41.790833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce649d-b545-4e74-9631-62e57e6bfad0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:41.791914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce649d-b545-4e74-9631-62e57e6bfad0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:41.792438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce649d-b545-4e74-9631-62e57e6bfad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:41.818990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d3ce649d-b545-4e74-9631-62e57e6bfad0 None None] MFA Rules not processed for user `9684fc6cb8364623b9c418ab316dafeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:41.821076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d3ce649d-b545-4e74-9631-62e57e6bfad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:41.909945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1205/2416] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:48.005117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=43 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:51.387786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:51.389260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:51.455706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a57cd-c2e9-4edf-864e-7b796dea4200 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:51.461793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:51.462603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:51.462723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:51.462981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] PATH_INFO: `/v3/users/3e83dc1ad3f44b7e80b2b891089bf8a0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:51.464211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e83dc1ad3f44b7e80b2b891089bf8a0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:51.466054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:51.542776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e83dc1ad3f44b7e80b2b891089bf8a0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:51.554779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e83dc1ad3f44b7e80b2b891089bf8a0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:51.562364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e83dc1ad3f44b7e80b2b891089bf8a0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:51.562993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e83dc1ad3f44b7e80b2b891089bf8a0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:51.570141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e83dc1ad3f44b7e80b2b891089bf8a0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:51.577018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1212/2417] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:15:51 2022] DELETE /identity/v3/users/3e83dc1ad3f44b7e80b2b891089bf8a0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:51.582166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725e9f-3779-4810-86fa-e16009167947 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:51.582644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725e9f-3779-4810-86fa-e16009167947 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:51.582757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725e9f-3779-4810-86fa-e16009167947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:51.603711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b0725e9f-3779-4810-86fa-e16009167947 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:51.604895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b0725e9f-3779-4810-86fa-e16009167947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:51.664153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1206/2418] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:51.673808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:51.675217 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:51.732491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995476c7-b509-461c-9e1b-5450ce6eb420 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:51.736105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78de3f-7ff7-4242-a9a9-bdb9f8727a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:51.736706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78de3f-7ff7-4242-a9a9-bdb9f8727a45 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:51.736984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78de3f-7ff7-4242-a9a9-bdb9f8727a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:51.737253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78de3f-7ff7-4242-a9a9-bdb9f8727a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:51.746795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78de3f-7ff7-4242-a9a9-bdb9f8727a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:51.748192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78de3f-7ff7-4242-a9a9-bdb9f8727a45 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:51.758316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1213/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:15:52.034137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0725e9f-3779-4810-86fa-e16009167947 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:52.036101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b0725e9f-3779-4810-86fa-e16009167947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:52.050709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0725e9f-3779-4810-86fa-e16009167947 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:52.055355 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:52.055992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:52.056267 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:52.056536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] PATH_INFO: `/v3/projects/3906e45b8dca486db9678b76fb9aa268` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:52.057754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3906e45b8dca486db9678b76fb9aa268)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:52.059696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:52.108363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:52.112456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3906e45b8dca486db9678b76fb9aa268', 'request_id': 'req-fbb56557-cd69-4635-9f8b-1b9e819afee4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:52.119781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3906e45b8dca486db9678b76fb9aa268', 'request_id': 'req-fbb56557-cd69-4635-9f8b-1b9e819afee4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:52.126408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3906e45b8dca486db9678b76fb9aa268', 'request_id': 'req-fbb56557-cd69-4635-9f8b-1b9e819afee4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:52.144166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] The token cache is being invalidate because project 3906e45b8dca486db9678b76fb9aa268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:15:52.144503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:52.145295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-fbb56557-cd69-4635-9f8b-1b9e819afee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:15:52.148176 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1207/2420] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:15:52 2022] DELETE /identity/v3/projects/3906e45b8dca486db9678b76fb9aa268 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:15:55.260957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502723-2ec0-49fb-986d-9dc941fef5be None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:55.261526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502723-2ec0-49fb-986d-9dc941fef5be None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:55.261526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502723-2ec0-49fb-986d-9dc941fef5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:55.283100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2d502723-2ec0-49fb-986d-9dc941fef5be None None] MFA Rules not processed for user `0921bd12cf52483689e1d1aec39155aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:55.284325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2d502723-2ec0-49fb-986d-9dc941fef5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:55.304014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:55.355286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1214/2421] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:55.959029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977be90-04c9-48e0-a558-38911a900ae7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:55.959501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977be90-04c9-48e0-a558-38911a900ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:55.959786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977be90-04c9-48e0-a558-38911a900ae7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:55.961830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1208/2422] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:15:55.970647 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c615-a8c5-480c-8ca3-6788cf54c0d4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:55.973549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c615-a8c5-480c-8ca3-6788cf54c0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:55.973876 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c615-a8c5-480c-8ca3-6788cf54c0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:56.007021 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ed49c615-a8c5-480c-8ca3-6788cf54c0d4 None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:56.008555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed49c615-a8c5-480c-8ca3-6788cf54c0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:56.107442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1215/2423] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:56.120376 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977be90-04c9-48e0-a558-38911a900ae7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:56.122259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4977be90-04c9-48e0-a558-38911a900ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:56.196330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977be90-04c9-48e0-a558-38911a900ae7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:56.200213 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da101-0b61-49b5-871c-6fdc5e0f033b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d637726e3142e6ba90fa201c764b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:56.200826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da101-0b61-49b5-871c-6fdc5e0f033b service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:56.201105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da101-0b61-49b5-871c-6fdc5e0f033b service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:56.201372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da101-0b61-49b5-871c-6fdc5e0f033b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:56.213637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314da101-0b61-49b5-871c-6fdc5e0f033b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:56.215116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314da101-0b61-49b5-871c-6fdc5e0f033b service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:56.232005 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1209/2424] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:56.316412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857229fd-71c9-4212-956c-a27d8e8a5a4f None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:56.316886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857229fd-71c9-4212-956c-a27d8e8a5a4f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:56.317116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857229fd-71c9-4212-956c-a27d8e8a5a4f None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:56.319097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1216/2425] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:15:56.326081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857290e-654d-4cad-86f4-84ed7155b274 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:56.326596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857290e-654d-4cad-86f4-84ed7155b274 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:56.327001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857290e-654d-4cad-86f4-84ed7155b274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:56.347821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1857290e-654d-4cad-86f4-84ed7155b274 None None] MFA Rules not processed for user `5a6ff1b9371a411bae7b3e45f78e05e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:56.349809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1857290e-654d-4cad-86f4-84ed7155b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:56.417498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1210/2426] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:56.429712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857229fd-71c9-4212-956c-a27d8e8a5a4f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:56.431437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-857229fd-71c9-4212-956c-a27d8e8a5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:56.444981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857229fd-71c9-4212-956c-a27d8e8a5a4f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:56.448495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeef53-822a-4896-b86f-0960d91e711d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:56.449086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeef53-822a-4896-b86f-0960d91e711d service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:56.449397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeef53-822a-4896-b86f-0960d91e711d service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:56.449726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeef53-822a-4896-b86f-0960d91e711d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:56.456588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeef53-822a-4896-b86f-0960d91e711d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:56.458054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeef53-822a-4896-b86f-0960d91e711d service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:56.466642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1217/2427] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:15:56.548422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407baea-acb6-40c2-ad71-c6c4f75159b8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:56.548747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407baea-acb6-40c2-ad71-c6c4f75159b8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:56.549026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407baea-acb6-40c2-ad71-c6c4f75159b8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:56.550682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1211/2428] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:15:56.556188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b003d-42a5-4aa6-b9ae-258d749b3673 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:56.556478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b003d-42a5-4aa6-b9ae-258d749b3673 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:56.556758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b003d-42a5-4aa6-b9ae-258d749b3673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:56.577144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3d2b003d-42a5-4aa6-b9ae-258d749b3673 None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:15:56.578399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3d2b003d-42a5-4aa6-b9ae-258d749b3673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:15:56.588348 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1218/2429] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:15:56.599051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407baea-acb6-40c2-ad71-c6c4f75159b8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:15:56.610031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407baea-acb6-40c2-ad71-c6c4f75159b8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:15:56.613630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:15:56.614225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:15:56.614611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:15:56.614889 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:15:56.625240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:15:56.626727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:15:56.638472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1212/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:15:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:16:01.084526 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b279781-e808-43f2-83fe-3c0fb749982b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:01.085009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b279781-e808-43f2-83fe-3c0fb749982b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:01.085098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b279781-e808-43f2-83fe-3c0fb749982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:01.104984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5b279781-e808-43f2-83fe-3c0fb749982b None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:16:01.106238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5b279781-e808-43f2-83fe-3c0fb749982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:16:01.170059 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1219/2431] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:16:01.193999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:16:01.195880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:16:01.268812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e64f3-cd9b-409b-aaa0-412ae52b3a9a service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:16:01.274425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d921568-0f13-48d9-9943-a2dd4744b69a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:16:01.275041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d921568-0f13-48d9-9943-a2dd4744b69a service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:01.275318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d921568-0f13-48d9-9943-a2dd4744b69a service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:01.275594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d921568-0f13-48d9-9943-a2dd4744b69a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:01.284246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d921568-0f13-48d9-9943-a2dd4744b69a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:16:01.285888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d921568-0f13-48d9-9943-a2dd4744b69a service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:16:01.294939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1213/2432] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:16:11.163151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=80 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:11.291546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:18.528233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3edc-0774-46d6-ba3c-be362408805c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:18.528725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3edc-0774-46d6-ba3c-be362408805c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:18.529044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3edc-0774-46d6-ba3c-be362408805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:18.550963 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4ccb3edc-0774-46d6-ba3c-be362408805c None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:16:18.552212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4ccb3edc-0774-46d6-ba3c-be362408805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:16:18.559816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1220/2433] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 8 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:16:18.581398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d921568-0f13-48d9-9943-a2dd4744b69a service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:16:18.592501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d921568-0f13-48d9-9943-a2dd4744b69a service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:16:18.597742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb72b1-c91b-4069-a2d0-04534fa9c1ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:16:18.598409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb72b1-c91b-4069-a2d0-04534fa9c1ad service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:18.598758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb72b1-c91b-4069-a2d0-04534fa9c1ad service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:18.599101 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb72b1-c91b-4069-a2d0-04534fa9c1ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:18.607993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb72b1-c91b-4069-a2d0-04534fa9c1ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:16:18.609682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb72b1-c91b-4069-a2d0-04534fa9c1ad service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:16:18.618287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1214/2434] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:16:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:16:28.185235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba75e05-c7db-4bc2-9244-6fe2a7625f05 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:28.185750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba75e05-c7db-4bc2-9244-6fe2a7625f05 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:28.185851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba75e05-c7db-4bc2-9244-6fe2a7625f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:28.204993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bba75e05-c7db-4bc2-9244-6fe2a7625f05 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:16:28.206232 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bba75e05-c7db-4bc2-9244-6fe2a7625f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:16:28.213371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1221/2435] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:16:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:16:28.225494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb72b1-c91b-4069-a2d0-04534fa9c1ad service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:16:28.236169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb72b1-c91b-4069-a2d0-04534fa9c1ad service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:16:28.241805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd203f9-be69-4bcb-afaf-b02eb0c8242f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:16:28.242408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd203f9-be69-4bcb-afaf-b02eb0c8242f service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:28.242745 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd203f9-be69-4bcb-afaf-b02eb0c8242f service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:28.243028 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd203f9-be69-4bcb-afaf-b02eb0c8242f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:28.251775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd203f9-be69-4bcb-afaf-b02eb0c8242f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:16:28.253686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd203f9-be69-4bcb-afaf-b02eb0c8242f service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:16:28.262333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1215/2436] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:16:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:16:38.200187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:38.259051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=12 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:43.808128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79410f-41d3-4b1a-af0d-4c1627028e05 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:43.808650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79410f-41d3-4b1a-af0d-4c1627028e05 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:43.808754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79410f-41d3-4b1a-af0d-4c1627028e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:43.830006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0f79410f-41d3-4b1a-af0d-4c1627028e05 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:16:43.831373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f79410f-41d3-4b1a-af0d-4c1627028e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:16:43.840533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1222/2437] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 8 01:16:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:16:43.853049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd203f9-be69-4bcb-afaf-b02eb0c8242f service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:16:43.863393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd203f9-be69-4bcb-afaf-b02eb0c8242f service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:16:43.868893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cda6f-803f-46d8-8806-460f9927d0d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:16:43.869509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cda6f-803f-46d8-8806-460f9927d0d9 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:43.869813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cda6f-803f-46d8-8806-460f9927d0d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:43.870084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cda6f-803f-46d8-8806-460f9927d0d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:43.878260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cda6f-803f-46d8-8806-460f9927d0d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:16:43.879825 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cda6f-803f-46d8-8806-460f9927d0d9 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:16:43.888281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1216/2438] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:16:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 01:16:46.055175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79410f-41d3-4b1a-af0d-4c1627028e05 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:16:46.056825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0f79410f-41d3-4b1a-af0d-4c1627028e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:16:46.146938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79410f-41d3-4b1a-af0d-4c1627028e05 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:16:46.151750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:16:46.152435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:46.152722 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:46.153000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] PATH_INFO: `/v3/users/0921bd12cf52483689e1d1aec39155aa` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:46.154202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0921bd12cf52483689e1d1aec39155aa)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:16:46.156417 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:16:46.219185 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0921bd12cf52483689e1d1aec39155aa'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.234972 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0921bd12cf52483689e1d1aec39155aa'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.244196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0921bd12cf52483689e1d1aec39155aa'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.244984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0921bd12cf52483689e1d1aec39155aa'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.253691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0921bd12cf52483689e1d1aec39155aa'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.260632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1223/2439] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:16:46 2022] DELETE /identity/v3/users/0921bd12cf52483689e1d1aec39155aa => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:16:46.453290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cda6f-803f-46d8-8806-460f9927d0d9 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:16:46.465866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cda6f-803f-46d8-8806-460f9927d0d9 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:16:46.527293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:16:46.527754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:16:46.528033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:16:46.528303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] PATH_INFO: `/v3/projects/4e25596e0ea643328064ec0718dedccd` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:16:46.529447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e25596e0ea643328064ec0718dedccd)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:16:46.531429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:16:46.580849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e25596e0ea643328064ec0718dedccd', 'request_id': 'req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.586564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e25596e0ea643328064ec0718dedccd', 'request_id': 'req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.592826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e25596e0ea643328064ec0718dedccd', 'request_id': 'req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.606310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] The token cache is being invalidate because project 4e25596e0ea643328064ec0718dedccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:16:46.606598 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.607214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c7c47b71-a1bc-4b1d-9e6f-b41a4124a8e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:16:46.608694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1217/2440] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:16:46 2022] DELETE /identity/v3/projects/4e25596e0ea643328064ec0718dedccd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:16:56.256166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:56.603281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:06.753300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:17:06.754918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:06.833471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d4d15-1040-4e13-80a9-330451d95efa admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:17:06.897882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622785a-cdda-4363-b6f6-0dd7eb57629d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:17:06.898506 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622785a-cdda-4363-b6f6-0dd7eb57629d service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:06.898790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622785a-cdda-4363-b6f6-0dd7eb57629d service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:06.899065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622785a-cdda-4363-b6f6-0dd7eb57629d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:06.900824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2622785a-cdda-4363-b6f6-0dd7eb57629d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:06.912918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622785a-cdda-4363-b6f6-0dd7eb57629d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:17:06.914928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622785a-cdda-4363-b6f6-0dd7eb57629d service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:17:06.925759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1224/2441] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:17:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:17:10.119906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f2f3d-a01a-41ce-aaf6-8cc35882b884 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:10.120386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f2f3d-a01a-41ce-aaf6-8cc35882b884 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:10.120478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f2f3d-a01a-41ce-aaf6-8cc35882b884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:10.139557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7c5f2f3d-a01a-41ce-aaf6-8cc35882b884 None None] MFA Rules not processed for user `b657cf5dbf394b9db923082f00565a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:17:10.140777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7c5f2f3d-a01a-41ce-aaf6-8cc35882b884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:10.199061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1218/2442] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:17:12.615035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69840a-f67d-4cb3-9e9e-9df88211f510 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:12.615539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69840a-f67d-4cb3-9e9e-9df88211f510 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:12.615638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69840a-f67d-4cb3-9e9e-9df88211f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:12.634756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3e69840a-f67d-4cb3-9e9e-9df88211f510 None None] MFA Rules not processed for user `9684fc6cb8364623b9c418ab316dafeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:17:12.635953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3e69840a-f67d-4cb3-9e9e-9df88211f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:12.691334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1225/2443] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:17:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:17:20.192006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=25 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:22.684553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=83 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:33.901524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eacc6-b8a5-4617-8aa8-60ff63efe054 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:33.901994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eacc6-b8a5-4617-8aa8-60ff63efe054 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:33.902093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eacc6-b8a5-4617-8aa8-60ff63efe054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:33.921668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-966eacc6-b8a5-4617-8aa8-60ff63efe054 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:17:33.922893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-966eacc6-b8a5-4617-8aa8-60ff63efe054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:33.982851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1219/2444] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 8 01:17:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:17:34.009340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69840a-f67d-4cb3-9e9e-9df88211f510 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:17:34.010884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3e69840a-f67d-4cb3-9e9e-9df88211f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:34.083427 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69840a-f67d-4cb3-9e9e-9df88211f510 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:17:34.088586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:17:34.089194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:34.089503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:34.089779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:34.099338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:17:34.101369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:17:34.110088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1226/2445] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:17:37.308346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05309f71-f9ad-4037-8ed5-911bbac1a3c2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:37.308806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05309f71-f9ad-4037-8ed5-911bbac1a3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:37.308925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05309f71-f9ad-4037-8ed5-911bbac1a3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:37.332709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-05309f71-f9ad-4037-8ed5-911bbac1a3c2 None None] MFA Rules not processed for user `e67e4e9e8c2c41c68dd7dd92a3297e93`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:17:37.334032 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-05309f71-f9ad-4037-8ed5-911bbac1a3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:37.395473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1220/2446] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:17:41.643485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:17:41.645587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:41.722881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb65d10-ed07-46c6-9802-37edff2afdaa service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:17:41.728610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:17:41.729244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:41.729567 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:41.730157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] PATH_INFO: `/v3/users/96d57472de274ccabb02dc210283b4be` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:41.731303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d57472de274ccabb02dc210283b4be)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:17:41.733212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:17:41.781502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d57472de274ccabb02dc210283b4be'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:41.796703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d57472de274ccabb02dc210283b4be'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:41.805446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d57472de274ccabb02dc210283b4be'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:41.806123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d57472de274ccabb02dc210283b4be'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:41.813627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d57472de274ccabb02dc210283b4be'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:41.819630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1227/2447] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:17:41 2022] DELETE /identity/v3/users/96d57472de274ccabb02dc210283b4be => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:17:42.002330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05309f71-f9ad-4037-8ed5-911bbac1a3c2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:17:42.017520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05309f71-f9ad-4037-8ed5-911bbac1a3c2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:17:42.077600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:17:42.078228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:42.078504 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:42.078773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] PATH_INFO: `/v3/projects/48058e2ed13c42888f79e67c1b074368` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:42.079896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] RBAC: Authorizing `identity:delete_project(project_id=48058e2ed13c42888f79e67c1b074368)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:17:42.081839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:17:42.130415 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48058e2ed13c42888f79e67c1b074368', 'request_id': 'req-27568682-fa63-49dd-aaec-a3f40c4b922f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.132437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:42.137863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48058e2ed13c42888f79e67c1b074368', 'request_id': 'req-27568682-fa63-49dd-aaec-a3f40c4b922f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.144621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48058e2ed13c42888f79e67c1b074368', 'request_id': 'req-27568682-fa63-49dd-aaec-a3f40c4b922f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.159268 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] The token cache is being invalidate because project 48058e2ed13c42888f79e67c1b074368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:17:42.159579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.160368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.162006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1221/2448] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:17:42 2022] DELETE /identity/v3/projects/48058e2ed13c42888f79e67c1b074368 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:17:42.166089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:17:42.167485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:42.180662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585cefb-0b4c-4e6a-b178-23892137cefb admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:17:42.185158 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:42.241046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:17:42.241713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:42.242016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:42.242265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] PATH_INFO: `/v3/users/4afc7b71b36f424abab51cf03abba5e7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:42.243409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afc7b71b36f424abab51cf03abba5e7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:17:42.245345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:17:42.292729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afc7b71b36f424abab51cf03abba5e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.304834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afc7b71b36f424abab51cf03abba5e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.311891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afc7b71b36f424abab51cf03abba5e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.312563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afc7b71b36f424abab51cf03abba5e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.320048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afc7b71b36f424abab51cf03abba5e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.326325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1228/2449] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:17:42 2022] DELETE /identity/v3/users/4afc7b71b36f424abab51cf03abba5e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:17:42.498933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:17:42.500616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:17:42.520521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27568682-fa63-49dd-aaec-a3f40c4b922f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:17:42.578909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:17:42.579555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:17:42.579813 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:17:42.580085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] PATH_INFO: `/v3/projects/4e87750a9b3d4db3aaad76c99d7e0b67` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:17:42.581189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e87750a9b3d4db3aaad76c99d7e0b67)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:17:42.583168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:17:42.628707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e87750a9b3d4db3aaad76c99d7e0b67', 'request_id': 'req-c0a5c127-1ea5-474a-858e-349250fb1cc9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.635120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e87750a9b3d4db3aaad76c99d7e0b67', 'request_id': 'req-c0a5c127-1ea5-474a-858e-349250fb1cc9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.641596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e87750a9b3d4db3aaad76c99d7e0b67', 'request_id': 'req-c0a5c127-1ea5-474a-858e-349250fb1cc9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.654196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] The token cache is being invalidate because project 4e87750a9b3d4db3aaad76c99d7e0b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:17:42.654488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.655102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:17:42.656557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1222/2450] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:17:42 2022] DELETE /identity/v3/projects/4e87750a9b3d4db3aaad76c99d7e0b67 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:17:52.322835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:52.651117 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:13.816531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:13.818219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:13.833098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ddb2e-794d-498b-8db4-ed128c4d9c8d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:13.899164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:13.899814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:13.900127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:13.900405 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] PATH_INFO: `/v3/users/9684fc6cb8364623b9c418ab316dafeb` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:13.901612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9684fc6cb8364623b9c418ab316dafeb)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:13.903545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:13.955239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9684fc6cb8364623b9c418ab316dafeb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:13.968273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9684fc6cb8364623b9c418ab316dafeb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:13.976384 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9684fc6cb8364623b9c418ab316dafeb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:13.977013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9684fc6cb8364623b9c418ab316dafeb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:13.984930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-4245fd21-84fe-4ded-82cd-fb94b75a9d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9684fc6cb8364623b9c418ab316dafeb'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:13.991168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1229/2451] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:18:13 2022] DELETE /identity/v3/users/9684fc6cb8364623b9c418ab316dafeb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:14.166102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.167612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:14.181625 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5c127-1ea5-474a-858e-349250fb1cc9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:14.238794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:14.239359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.239668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.239943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] PATH_INFO: `/v3/projects/4994044e8688482195339ae8037ec215` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.241061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4994044e8688482195339ae8037ec215)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:14.243605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:14.289340 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4994044e8688482195339ae8037ec215', 'request_id': 'req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:14.294766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4994044e8688482195339ae8037ec215', 'request_id': 'req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:14.300783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4994044e8688482195339ae8037ec215', 'request_id': 'req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:14.314182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] The token cache is being invalidate because project 4994044e8688482195339ae8037ec215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:18:14.314469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:14.315079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b798bf64-bca8-41d6-b8f0-7ad244a2abc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:14.316751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1223/2452] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:18:14 2022] DELETE /identity/v3/projects/4994044e8688482195339ae8037ec215 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:14.321375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c6fc-43f9-4983-83c5-640c587e07f8 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.321709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c6fc-43f9-4983-83c5-640c587e07f8 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.321985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c6fc-43f9-4983-83c5-640c587e07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.343541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d155c6fc-43f9-4983-83c5-640c587e07f8 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:14.344759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d155c6fc-43f9-4983-83c5-640c587e07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:14.406335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1230/2453] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:14.414669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9cd4-1587-4e07-b6d5-9df97e1caf23 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.414886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9cd4-1587-4e07-b6d5-9df97e1caf23 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.415160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9cd4-1587-4e07-b6d5-9df97e1caf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.444136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7f9b9cd4-1587-4e07-b6d5-9df97e1caf23 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:14.447048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7f9b9cd4-1587-4e07-b6d5-9df97e1caf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:14.456046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1224/2454] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:18:14.460194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c6fc-43f9-4983-83c5-640c587e07f8 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.471449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c6fc-43f9-4983-83c5-640c587e07f8 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:14.477792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:14.478415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.478693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.478961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.479613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:18:14.479913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:14.481528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:14.498889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1231/2455] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:18:14.499641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b9cd4-1587-4e07-b6d5-9df97e1caf23 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.518694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b9cd4-1587-4e07-b6d5-9df97e1caf23 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:14.524093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122887e4-5c99-4107-827b-ba4d79310508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:14.524697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122887e4-5c99-4107-827b-ba4d79310508 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.524981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122887e4-5c99-4107-827b-ba4d79310508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.525249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122887e4-5c99-4107-827b-ba4d79310508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.525950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122887e4-5c99-4107-827b-ba4d79310508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:14.527906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122887e4-5c99-4107-827b-ba4d79310508 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:14.555359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1225/2456] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:18:14 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:14.559489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.569245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea73a27-babf-4909-a699-2c28a71630dc admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:14.572805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:14.627081 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc33f-3c03-4140-b470-282ac914a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:14.627949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc33f-3c03-4140-b470-282ac914a9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.628236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc33f-3c03-4140-b470-282ac914a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.628509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc33f-3c03-4140-b470-282ac914a9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.629135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edc33f-3c03-4140-b470-282ac914a9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:14.631090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edc33f-3c03-4140-b470-282ac914a9d1 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:14.652132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1232/2457] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:18:14 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:14.656253 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122887e4-5c99-4107-827b-ba4d79310508 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.667281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122887e4-5c99-4107-827b-ba4d79310508 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:14.671931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a892813-dc1b-4d0f-82d3-932c15a66fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:14.672526 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a892813-dc1b-4d0f-82d3-932c15a66fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.672807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a892813-dc1b-4d0f-82d3-932c15a66fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.673082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a892813-dc1b-4d0f-82d3-932c15a66fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.673787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a892813-dc1b-4d0f-82d3-932c15a66fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:14.675382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a892813-dc1b-4d0f-82d3-932c15a66fc6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:14.685022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1226/2458] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:14.688823 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc33f-3c03-4140-b470-282ac914a9d1 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.698615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc33f-3c03-4140-b470-282ac914a9d1 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:14.703197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da4ec8-7716-4bb9-8be7-7d70f93499a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:14.703800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da4ec8-7716-4bb9-8be7-7d70f93499a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.704078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da4ec8-7716-4bb9-8be7-7d70f93499a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.704348 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da4ec8-7716-4bb9-8be7-7d70f93499a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.704982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da4ec8-7716-4bb9-8be7-7d70f93499a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:14.706598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da4ec8-7716-4bb9-8be7-7d70f93499a4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:14.717510 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1233/2459] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:18:14.721378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a892813-dc1b-4d0f-82d3-932c15a66fc6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.731740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a892813-dc1b-4d0f-82d3-932c15a66fc6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:14.736306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf4b0-eb8a-4ce3-9d93-b119450b739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:14.736940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf4b0-eb8a-4ce3-9d93-b119450b739f admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.737219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf4b0-eb8a-4ce3-9d93-b119450b739f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.737522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf4b0-eb8a-4ce3-9d93-b119450b739f admin admin] PATH_INFO: `/v3/projects/710e38e43d734063a34a7cafa0c2af70/users/a2d3c75a12aa45feaa61b077bbfab21c/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.752931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bf4b0-eb8a-4ce3-9d93-b119450b739f admin admin] RBAC: Authorizing `identity:create_grant(project_id=710e38e43d734063a34a7cafa0c2af70, user_id=a2d3c75a12aa45feaa61b077bbfab21c, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:14.755753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bf4b0-eb8a-4ce3-9d93-b119450b739f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:14.768383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1227/2460] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:14 2022] PUT /identity/v3/projects/710e38e43d734063a34a7cafa0c2af70/users/a2d3c75a12aa45feaa61b077bbfab21c/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:14.778825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775b17-43b6-40ae-82a8-3d7fc3af4543 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.779108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775b17-43b6-40ae-82a8-3d7fc3af4543 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.779378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775b17-43b6-40ae-82a8-3d7fc3af4543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.806942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-09775b17-43b6-40ae-82a8-3d7fc3af4543 None None] MFA Rules not processed for user `a2d3c75a12aa45feaa61b077bbfab21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:14.808215 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-09775b17-43b6-40ae-82a8-3d7fc3af4543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:14.871991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1234/2461] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:14.876667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf4b0-eb8a-4ce3-9d93-b119450b739f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.907277 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:14.941705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf4b0-eb8a-4ce3-9d93-b119450b739f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:14.946368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cbf79-ddae-45ed-b102-99342d7d4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:14.946964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbf79-ddae-45ed-b102-99342d7d4399 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:14.947245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbf79-ddae-45ed-b102-99342d7d4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:14.947515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbf79-ddae-45ed-b102-99342d7d4399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:14.948138 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cbf79-ddae-45ed-b102-99342d7d4399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:14.950082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cbf79-ddae-45ed-b102-99342d7d4399 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:14.977292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1228/2462] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:18:14 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:14.981476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09775b17-43b6-40ae-82a8-3d7fc3af4543 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:14.992191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09775b17-43b6-40ae-82a8-3d7fc3af4543 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:15.048622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b372153-39a0-4466-9303-7f08550464f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:15.049228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372153-39a0-4466-9303-7f08550464f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.049541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372153-39a0-4466-9303-7f08550464f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.049815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372153-39a0-4466-9303-7f08550464f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.050443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b372153-39a0-4466-9303-7f08550464f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:15.052355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b372153-39a0-4466-9303-7f08550464f9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:15.073090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1235/2463] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:18:14 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:15.077122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cbf79-ddae-45ed-b102-99342d7d4399 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:15.087909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cbf79-ddae-45ed-b102-99342d7d4399 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:15.092503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074f057-72d8-4ef1-a6b3-77f7fc8e4408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:15.093094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074f057-72d8-4ef1-a6b3-77f7fc8e4408 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.093375 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074f057-72d8-4ef1-a6b3-77f7fc8e4408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.093677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074f057-72d8-4ef1-a6b3-77f7fc8e4408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.094315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074f057-72d8-4ef1-a6b3-77f7fc8e4408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:15.095898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074f057-72d8-4ef1-a6b3-77f7fc8e4408 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:15.106379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1229/2464] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:15.110220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b372153-39a0-4466-9303-7f08550464f9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:15.116437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:15.120140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b372153-39a0-4466-9303-7f08550464f9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:15.125594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae89d8-8c7e-43b6-9702-7563022f8600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:15.126233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae89d8-8c7e-43b6-9702-7563022f8600 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.126513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae89d8-8c7e-43b6-9702-7563022f8600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.126788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae89d8-8c7e-43b6-9702-7563022f8600 admin admin] PATH_INFO: `/v3/projects/8e94952af8e744c19e0f497ac037cf51/users/b4cbc4d24a934a69b8cb1f6ee2a44bfe/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.142150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae89d8-8c7e-43b6-9702-7563022f8600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e94952af8e744c19e0f497ac037cf51, user_id=b4cbc4d24a934a69b8cb1f6ee2a44bfe, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:15.144808 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae89d8-8c7e-43b6-9702-7563022f8600 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:15.157250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1236/2465] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:15 2022] PUT /identity/v3/projects/8e94952af8e744c19e0f497ac037cf51/users/b4cbc4d24a934a69b8cb1f6ee2a44bfe/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:18:15.161122 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074f057-72d8-4ef1-a6b3-77f7fc8e4408 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:15.171133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074f057-72d8-4ef1-a6b3-77f7fc8e4408 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:15.229603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934a9a5-55fc-4475-bd09-488f1aa3a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:15.230126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a9a5-55fc-4475-bd09-488f1aa3a6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.230410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a9a5-55fc-4475-bd09-488f1aa3a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.230684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a9a5-55fc-4475-bd09-488f1aa3a6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.231321 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934a9a5-55fc-4475-bd09-488f1aa3a6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:15.232918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934a9a5-55fc-4475-bd09-488f1aa3a6a3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:15.243121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1230/2466] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:15.247763 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae89d8-8c7e-43b6-9702-7563022f8600 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:15.258907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae89d8-8c7e-43b6-9702-7563022f8600 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:15.263866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:15.264586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.264911 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.265208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] PATH_INFO: `/v3/projects/8e94952af8e744c19e0f497ac037cf51/users/b4cbc4d24a934a69b8cb1f6ee2a44bfe/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.267279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e94952af8e744c19e0f497ac037cf51, user_id=b4cbc4d24a934a69b8cb1f6ee2a44bfe, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:15.270169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:15.280495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1237/2467] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:15 2022] PUT /identity/v3/projects/8e94952af8e744c19e0f497ac037cf51/users/b4cbc4d24a934a69b8cb1f6ee2a44bfe/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:15.291616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcd8d9-a019-4a1d-b450-f701db2c6121 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.291898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcd8d9-a019-4a1d-b450-f701db2c6121 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.292167 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcd8d9-a019-4a1d-b450-f701db2c6121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.319511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c9fcd8d9-a019-4a1d-b450-f701db2c6121 None None] MFA Rules not processed for user `b4cbc4d24a934a69b8cb1f6ee2a44bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:15.321333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c9fcd8d9-a019-4a1d-b450-f701db2c6121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:15.388398 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1231/2468] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:15.399492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:15.401177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:15.463075 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dcdbb-5f83-49cd-946e-868fb7df21a7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:15.466739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adbf6c-8a26-4edd-baa4-464199fa6d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:15.467329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adbf6c-8a26-4edd-baa4-464199fa6d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.467609 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adbf6c-8a26-4edd-baa4-464199fa6d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.467877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adbf6c-8a26-4edd-baa4-464199fa6d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.476847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adbf6c-8a26-4edd-baa4-464199fa6d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:15.478350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adbf6c-8a26-4edd-baa4-464199fa6d1e service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:15.487758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1238/2469] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:15.518096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcd8d9-a019-4a1d-b450-f701db2c6121 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:15.542816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:15.582562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcd8d9-a019-4a1d-b450-f701db2c6121 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:15.587219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:15.587853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.588135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.588410 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] PATH_INFO: `/v3/users/a2d3c75a12aa45feaa61b077bbfab21c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.589579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d3c75a12aa45feaa61b077bbfab21c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:15.591567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:15.643502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d3c75a12aa45feaa61b077bbfab21c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:15.650920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d3c75a12aa45feaa61b077bbfab21c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:15.664826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d3c75a12aa45feaa61b077bbfab21c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:15.665597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d3c75a12aa45feaa61b077bbfab21c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:15.673011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d3c75a12aa45feaa61b077bbfab21c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:15.679174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1232/2470] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:18:15 2022] DELETE /identity/v3/users/a2d3c75a12aa45feaa61b077bbfab21c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:15.684674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754affb-7780-4bb1-b97e-11470f0fc69a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.684960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754affb-7780-4bb1-b97e-11470f0fc69a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.685236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754affb-7780-4bb1-b97e-11470f0fc69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.704106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7754affb-7780-4bb1-b97e-11470f0fc69a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:15.705381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7754affb-7780-4bb1-b97e-11470f0fc69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:15.764411 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1239/2471] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:15.774141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:15.775533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:15.833108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744bd28-2ee9-4b7b-a9f5-a4dbf201fbf4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:15.836859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526bb2-f996-4cfa-980b-c048b0dd202a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:15.837493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526bb2-f996-4cfa-980b-c048b0dd202a service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:15.837778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526bb2-f996-4cfa-980b-c048b0dd202a service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:15.838052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3526bb2-f996-4cfa-980b-c048b0dd202a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:15.847069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3526bb2-f996-4cfa-980b-c048b0dd202a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:15.848502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3526bb2-f996-4cfa-980b-c048b0dd202a service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:15.858466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1233/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:16.121019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754affb-7780-4bb1-b97e-11470f0fc69a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:16.122477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7754affb-7780-4bb1-b97e-11470f0fc69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:16.136473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754affb-7780-4bb1-b97e-11470f0fc69a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:16.141278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:16.142080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:16.142350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:16.142622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] PATH_INFO: `/v3/projects/710e38e43d734063a34a7cafa0c2af70` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:16.143815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710e38e43d734063a34a7cafa0c2af70)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:16.145788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:16.194022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710e38e43d734063a34a7cafa0c2af70', 'request_id': 'req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.208983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710e38e43d734063a34a7cafa0c2af70', 'request_id': 'req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.215690 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710e38e43d734063a34a7cafa0c2af70', 'request_id': 'req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.216777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:16.228833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] The token cache is being invalidate because project 710e38e43d734063a34a7cafa0c2af70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:18:16.229489 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.230192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.231766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1240/2473] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:18:16 2022] DELETE /identity/v3/projects/710e38e43d734063a34a7cafa0c2af70 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:16.239211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526bb2-f996-4cfa-980b-c048b0dd202a service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:16.252544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3526bb2-f996-4cfa-980b-c048b0dd202a service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:16.299576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:16.314847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:16.315469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:16.315752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:16.316027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] PATH_INFO: `/v3/users/b4cbc4d24a934a69b8cb1f6ee2a44bfe` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:16.317132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cbc4d24a934a69b8cb1f6ee2a44bfe)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:16.319088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:16.364174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cbc4d24a934a69b8cb1f6ee2a44bfe'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.371190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cbc4d24a934a69b8cb1f6ee2a44bfe'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.383910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cbc4d24a934a69b8cb1f6ee2a44bfe'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.384542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cbc4d24a934a69b8cb1f6ee2a44bfe'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.391362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-07796e61-c593-4bdc-8784-4c0c744a27dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cbc4d24a934a69b8cb1f6ee2a44bfe'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.397140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1234/2474] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:18:16 2022] DELETE /identity/v3/users/b4cbc4d24a934a69b8cb1f6ee2a44bfe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:16.667420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:16.668886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:16.681867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fd04f-383d-4ed7-8c36-4fb9a65992b9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:16.746032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:16.746674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:16.746962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:16.747242 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] PATH_INFO: `/v3/projects/8e94952af8e744c19e0f497ac037cf51` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:16.748373 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e94952af8e744c19e0f497ac037cf51)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:16.750380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:16.800630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e94952af8e744c19e0f497ac037cf51', 'request_id': 'req-cf25a13b-48bf-447b-8e2f-8d172e359c26'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.808250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e94952af8e744c19e0f497ac037cf51', 'request_id': 'req-cf25a13b-48bf-447b-8e2f-8d172e359c26'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.814144 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e94952af8e744c19e0f497ac037cf51', 'request_id': 'req-cf25a13b-48bf-447b-8e2f-8d172e359c26'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.825764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] The token cache is being invalidate because project 8e94952af8e744c19e0f497ac037cf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:18:16.826056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.826716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-cf25a13b-48bf-447b-8e2f-8d172e359c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:16.828206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1241/2475] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:18:16 2022] DELETE /identity/v3/projects/8e94952af8e744c19e0f497ac037cf51 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:16.833164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205ebd-b6d0-4c98-9778-10bf49c96289 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:16.833486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205ebd-b6d0-4c98-9778-10bf49c96289 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:16.833773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205ebd-b6d0-4c98-9778-10bf49c96289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:16.855784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1e205ebd-b6d0-4c98-9778-10bf49c96289 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:16.856906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1e205ebd-b6d0-4c98-9778-10bf49c96289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:16.918150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1235/2476] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:16.926777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9069b-4682-40f4-8a1e-6f5628e4e031 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:16.927065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9069b-4682-40f4-8a1e-6f5628e4e031 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:16.927350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9069b-4682-40f4-8a1e-6f5628e4e031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:16.957456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-47f9069b-4682-40f4-8a1e-6f5628e4e031 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:16.958671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-47f9069b-4682-40f4-8a1e-6f5628e4e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:16.967106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1242/2477] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:16.971428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e205ebd-b6d0-4c98-9778-10bf49c96289 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:16.981731 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e205ebd-b6d0-4c98-9778-10bf49c96289 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:16.986244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:16.986836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:16.987114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:16.987383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:16.988021 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:18:16.988320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:16.989946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.001218 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1236/2478] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:18:17.005707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9069b-4682-40f4-8a1e-6f5628e4e031 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.014784 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9069b-4682-40f4-8a1e-6f5628e4e031 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.019741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c0ecc-d5a7-418d-8f09-4c220e3d1172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.020341 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c0ecc-d5a7-418d-8f09-4c220e3d1172 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.020624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c0ecc-d5a7-418d-8f09-4c220e3d1172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.020899 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c0ecc-d5a7-418d-8f09-4c220e3d1172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.021583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c0ecc-d5a7-418d-8f09-4c220e3d1172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.024149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c0ecc-d5a7-418d-8f09-4c220e3d1172 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.051247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1243/2479] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:18:17 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:17.056743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.066859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fded2-b7f6-47e2-a87f-22bf9201d766 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.113881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:17.124985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069af7-e520-4abe-88a6-b73c137dbc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.125630 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069af7-e520-4abe-88a6-b73c137dbc63 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.126102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069af7-e520-4abe-88a6-b73c137dbc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.126602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069af7-e520-4abe-88a6-b73c137dbc63 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.127245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90069af7-e520-4abe-88a6-b73c137dbc63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.129594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90069af7-e520-4abe-88a6-b73c137dbc63 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.151549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1237/2480] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:18:17 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:17.155261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c0ecc-d5a7-418d-8f09-4c220e3d1172 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.165619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c0ecc-d5a7-418d-8f09-4c220e3d1172 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.170293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4684a0-ba1f-42aa-8086-02e64685ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.170888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4684a0-ba1f-42aa-8086-02e64685ab76 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.171171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4684a0-ba1f-42aa-8086-02e64685ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.171450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4684a0-ba1f-42aa-8086-02e64685ab76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.172091 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4684a0-ba1f-42aa-8086-02e64685ab76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.173787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4684a0-ba1f-42aa-8086-02e64685ab76 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.184053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1244/2481] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:17.188008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069af7-e520-4abe-88a6-b73c137dbc63 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.198528 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069af7-e520-4abe-88a6-b73c137dbc63 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.203143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ddf45-9fa4-4026-9d79-3973c2f25013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.203732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ddf45-9fa4-4026-9d79-3973c2f25013 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.204013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ddf45-9fa4-4026-9d79-3973c2f25013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.204281 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ddf45-9fa4-4026-9d79-3973c2f25013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.204915 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ddf45-9fa4-4026-9d79-3973c2f25013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.206538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ddf45-9fa4-4026-9d79-3973c2f25013 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.217674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1238/2482] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:17.221766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4684a0-ba1f-42aa-8086-02e64685ab76 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.232335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4684a0-ba1f-42aa-8086-02e64685ab76 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.236957 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751bc7f-0012-46ab-9c15-f9858571cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.237628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751bc7f-0012-46ab-9c15-f9858571cd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.237910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751bc7f-0012-46ab-9c15-f9858571cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.238186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751bc7f-0012-46ab-9c15-f9858571cd79 admin admin] PATH_INFO: `/v3/projects/94a8a88ccf324cfb807726fcb35e326d/users/86f3863a99a44f278bd6ddd35bd7d697/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.253673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751bc7f-0012-46ab-9c15-f9858571cd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a8a88ccf324cfb807726fcb35e326d, user_id=86f3863a99a44f278bd6ddd35bd7d697, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.256353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751bc7f-0012-46ab-9c15-f9858571cd79 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.272491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1245/2483] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:17 2022] PUT /identity/v3/projects/94a8a88ccf324cfb807726fcb35e326d/users/86f3863a99a44f278bd6ddd35bd7d697/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:17.281588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cc61-2eba-4ed7-bfee-25c7fe9d6aab None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.282094 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cc61-2eba-4ed7-bfee-25c7fe9d6aab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.282589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cc61-2eba-4ed7-bfee-25c7fe9d6aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.310696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ce24cc61-2eba-4ed7-bfee-25c7fe9d6aab None None] MFA Rules not processed for user `86f3863a99a44f278bd6ddd35bd7d697`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:17.311923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ce24cc61-2eba-4ed7-bfee-25c7fe9d6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:17.375435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1239/2484] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:17 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:17.380212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751bc7f-0012-46ab-9c15-f9858571cd79 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.401884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:17.442734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751bc7f-0012-46ab-9c15-f9858571cd79 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.447901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ec6b-69b0-4e46-a439-0ee5c587e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.448495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ec6b-69b0-4e46-a439-0ee5c587e916 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.448781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ec6b-69b0-4e46-a439-0ee5c587e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.449057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ec6b-69b0-4e46-a439-0ee5c587e916 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.449720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ec6b-69b0-4e46-a439-0ee5c587e916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.451632 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ec6b-69b0-4e46-a439-0ee5c587e916 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.477952 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1246/2485] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:18:17 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:17.482012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cc61-2eba-4ed7-bfee-25c7fe9d6aab None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.493249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cc61-2eba-4ed7-bfee-25c7fe9d6aab None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.549835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e3fe-f01a-45bf-a9d9-b7c1e1cf8e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.550443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e3fe-f01a-45bf-a9d9-b7c1e1cf8e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.550725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e3fe-f01a-45bf-a9d9-b7c1e1cf8e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.551000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337e3fe-f01a-45bf-a9d9-b7c1e1cf8e4c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.551636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337e3fe-f01a-45bf-a9d9-b7c1e1cf8e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.553593 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337e3fe-f01a-45bf-a9d9-b7c1e1cf8e4c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.574910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1240/2486] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:18:17 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:17.579165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ec6b-69b0-4e46-a439-0ee5c587e916 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.591668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ec6b-69b0-4e46-a439-0ee5c587e916 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.602916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99600ca0-36b7-44d5-ba68-e66316edbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.603538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600ca0-36b7-44d5-ba68-e66316edbb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.604619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600ca0-36b7-44d5-ba68-e66316edbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.605866 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600ca0-36b7-44d5-ba68-e66316edbb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.606531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99600ca0-36b7-44d5-ba68-e66316edbb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.608130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99600ca0-36b7-44d5-ba68-e66316edbb3e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.620244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1247/2487] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:17.624771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e3fe-f01a-45bf-a9d9-b7c1e1cf8e4c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.636139 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337e3fe-f01a-45bf-a9d9-b7c1e1cf8e4c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.640901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868a23-7fb0-4bbd-8d2d-0918306e9395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.641596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868a23-7fb0-4bbd-8d2d-0918306e9395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.641882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868a23-7fb0-4bbd-8d2d-0918306e9395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.642161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86868a23-7fb0-4bbd-8d2d-0918306e9395 admin admin] PATH_INFO: `/v3/projects/9ce74cbd3f6243b99a39a3ec1f0920a9/users/0a523578b5104bbd9f5d46b6e67e4435/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.657304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86868a23-7fb0-4bbd-8d2d-0918306e9395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce74cbd3f6243b99a39a3ec1f0920a9, user_id=0a523578b5104bbd9f5d46b6e67e4435, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.660015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86868a23-7fb0-4bbd-8d2d-0918306e9395 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.672708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1241/2488] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:17 2022] PUT /identity/v3/projects/9ce74cbd3f6243b99a39a3ec1f0920a9/users/0a523578b5104bbd9f5d46b6e67e4435/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:18:17.676763 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99600ca0-36b7-44d5-ba68-e66316edbb3e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.687335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99600ca0-36b7-44d5-ba68-e66316edbb3e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.744128 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3f7b0-5a20-4361-9fa7-79b2b5f0d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.744734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f7b0-5a20-4361-9fa7-79b2b5f0d3bb admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.745015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f7b0-5a20-4361-9fa7-79b2b5f0d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.745287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f7b0-5a20-4361-9fa7-79b2b5f0d3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.745951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f7b0-5a20-4361-9fa7-79b2b5f0d3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.747546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f7b0-5a20-4361-9fa7-79b2b5f0d3bb admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.758255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1248/2489] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:18:17.762426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868a23-7fb0-4bbd-8d2d-0918306e9395 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.772738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86868a23-7fb0-4bbd-8d2d-0918306e9395 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:17.777351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:17.778029 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.778317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.778581 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] PATH_INFO: `/v3/projects/9ce74cbd3f6243b99a39a3ec1f0920a9/users/0a523578b5104bbd9f5d46b6e67e4435/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.780474 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce74cbd3f6243b99a39a3ec1f0920a9, user_id=0a523578b5104bbd9f5d46b6e67e4435, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:17.783157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:17.793151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1242/2490] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:17 2022] PUT /identity/v3/projects/9ce74cbd3f6243b99a39a3ec1f0920a9/users/0a523578b5104bbd9f5d46b6e67e4435/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:17.803977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f3a3f-9825-429f-9568-f99f17014ad0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:17.804825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f3a3f-9825-429f-9568-f99f17014ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:17.805106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f3a3f-9825-429f-9568-f99f17014ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:17.832100 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-275f3a3f-9825-429f-9568-f99f17014ad0 None None] MFA Rules not processed for user `0a523578b5104bbd9f5d46b6e67e4435`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:17.833306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-275f3a3f-9825-429f-9568-f99f17014ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:17.902878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1249/2491] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:17 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:17.910974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:17.912746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:17.937622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:18.009974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcafb1-c18c-471e-8642-dae10edd052c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:18.013621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:18.014256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:18.014576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:18.014877 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:18.026417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:18.027923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:18.037681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1243/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:17 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:18.185371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f3a3f-9825-429f-9568-f99f17014ad0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:18.194885 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f3a3f-9825-429f-9568-f99f17014ad0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:18.198398 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1b229-117e-4610-81bb-b7ccf62f4559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:18.198980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1b229-117e-4610-81bb-b7ccf62f4559 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:18.199261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1b229-117e-4610-81bb-b7ccf62f4559 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:18.199531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1b229-117e-4610-81bb-b7ccf62f4559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:18.211678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:18.271026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1b229-117e-4610-81bb-b7ccf62f4559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:18.272458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1b229-117e-4610-81bb-b7ccf62f4559 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:18.293724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1250/2493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:18 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:21.480995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:21.482395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:21.539779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465961ce-c527-44e5-a12d-65a64ec7a326 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:21.543364 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:21.543965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:21.544242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:21.544510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:21.546244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:21.615456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:21.617588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:21.628784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1244/2494] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:22.810354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1b229-117e-4610-81bb-b7ccf62f4559 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:22.820501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1b229-117e-4610-81bb-b7ccf62f4559 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:22.824095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d4a27-1275-413c-9d52-33f81f074b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:22.824689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4a27-1275-413c-9d52-33f81f074b81 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:22.824973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4a27-1275-413c-9d52-33f81f074b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:22.825248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4a27-1275-413c-9d52-33f81f074b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:22.827009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a69d4a27-1275-413c-9d52-33f81f074b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:22.840133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d4a27-1275-413c-9d52-33f81f074b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:22.841578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d4a27-1275-413c-9d52-33f81f074b81 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:22.853092 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1251/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:23.548857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:23.604543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:23.610750 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1782bde-cd15-453a-b1fc-5a5c0f332442 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:23.615266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:23.615883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:23.616164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:23.616462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] PATH_INFO: `/v3/users/86f3863a99a44f278bd6ddd35bd7d697` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:23.617603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f3863a99a44f278bd6ddd35bd7d697)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:23.619554 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:23.666605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f3863a99a44f278bd6ddd35bd7d697'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:23.673725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f3863a99a44f278bd6ddd35bd7d697'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:23.686200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f3863a99a44f278bd6ddd35bd7d697'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:23.686859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f3863a99a44f278bd6ddd35bd7d697'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:23.695231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f3863a99a44f278bd6ddd35bd7d697'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:23.701691 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1245/2496] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:18:23 2022] DELETE /identity/v3/users/86f3863a99a44f278bd6ddd35bd7d697 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:23.706433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6813-bad5-4d1f-9a1a-94632a359ce7 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:23.706717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6813-bad5-4d1f-9a1a-94632a359ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:23.706991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6813-bad5-4d1f-9a1a-94632a359ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:23.727049 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-65bf6813-bad5-4d1f-9a1a-94632a359ce7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:23.728260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-65bf6813-bad5-4d1f-9a1a-94632a359ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:23.785700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1252/2497] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:23.796269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:23.797846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:23.855379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd7e7e-db87-4307-a68b-31718aa6777d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:23.859073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a104497-f6d3-412d-add8-c196af858535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:23.859677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104497-f6d3-412d-add8-c196af858535 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:23.859964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104497-f6d3-412d-add8-c196af858535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:23.860235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104497-f6d3-412d-add8-c196af858535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:23.869170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a104497-f6d3-412d-add8-c196af858535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:23.870626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a104497-f6d3-412d-add8-c196af858535 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:23.880230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1246/2498] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:24.150469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf6813-bad5-4d1f-9a1a-94632a359ce7 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:24.151931 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-65bf6813-bad5-4d1f-9a1a-94632a359ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:24.168521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf6813-bad5-4d1f-9a1a-94632a359ce7 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:24.173167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:24.173834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:24.174112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:24.174382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] PATH_INFO: `/v3/projects/94a8a88ccf324cfb807726fcb35e326d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:24.175546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a8a88ccf324cfb807726fcb35e326d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:24.177598 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:24.223478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a8a88ccf324cfb807726fcb35e326d', 'request_id': 'req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.230102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a8a88ccf324cfb807726fcb35e326d', 'request_id': 'req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.235999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a8a88ccf324cfb807726fcb35e326d', 'request_id': 'req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.247482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] The token cache is being invalidate because project 94a8a88ccf324cfb807726fcb35e326d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:18:24.247770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.248411 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.249914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1253/2499] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:18:24 2022] DELETE /identity/v3/projects/94a8a88ccf324cfb807726fcb35e326d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:18:24.254231 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a104497-f6d3-412d-add8-c196af858535 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:24.264687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a104497-f6d3-412d-add8-c196af858535 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:24.319484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:24.320712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:24.320990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:24.321292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] PATH_INFO: `/v3/users/0a523578b5104bbd9f5d46b6e67e4435` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:24.322441 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a523578b5104bbd9f5d46b6e67e4435)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:24.324370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:24.344234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:24.370106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a523578b5104bbd9f5d46b6e67e4435'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.377432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a523578b5104bbd9f5d46b6e67e4435'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.390278 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a523578b5104bbd9f5d46b6e67e4435'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.390898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a523578b5104bbd9f5d46b6e67e4435'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.397769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-03712b92-57a3-475d-8850-90f8b80d31d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a523578b5104bbd9f5d46b6e67e4435'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.403599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1247/2500] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:18:24 2022] DELETE /identity/v3/users/0a523578b5104bbd9f5d46b6e67e4435 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:24.667276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:24.668698 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:24.682657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab02e2c-6e95-4c5f-bd69-43c27847f1fe admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:24.703090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:24.741125 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:24.742338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:24.742619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:24.742893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] PATH_INFO: `/v3/projects/9ce74cbd3f6243b99a39a3ec1f0920a9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:24.744001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce74cbd3f6243b99a39a3ec1f0920a9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:24.745945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:24.791117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce74cbd3f6243b99a39a3ec1f0920a9', 'request_id': 'req-094abb13-073b-4371-8f35-7c4f5a395eba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.799259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce74cbd3f6243b99a39a3ec1f0920a9', 'request_id': 'req-094abb13-073b-4371-8f35-7c4f5a395eba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.805571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce74cbd3f6243b99a39a3ec1f0920a9', 'request_id': 'req-094abb13-073b-4371-8f35-7c4f5a395eba'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.816766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] The token cache is being invalidate because project 9ce74cbd3f6243b99a39a3ec1f0920a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:18:24.817055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.817919 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-094abb13-073b-4371-8f35-7c4f5a395eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:24.819457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1254/2501] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:18:24 2022] DELETE /identity/v3/projects/9ce74cbd3f6243b99a39a3ec1f0920a9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:24.824430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef2d-2c76-48ab-99bf-b4c15745c42e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:24.824900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef2d-2c76-48ab-99bf-b4c15745c42e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:24.825011 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef2d-2c76-48ab-99bf-b4c15745c42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:24.844319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7dc7ef2d-2c76-48ab-99bf-b4c15745c42e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:24.845587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7dc7ef2d-2c76-48ab-99bf-b4c15745c42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:24.904070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1248/2502] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:24.911860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222be0a-4599-4117-9604-d06287a7f3f0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:24.912148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222be0a-4599-4117-9604-d06287a7f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:24.912482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222be0a-4599-4117-9604-d06287a7f3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:24.932835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6222be0a-4599-4117-9604-d06287a7f3f0 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:24.934055 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6222be0a-4599-4117-9604-d06287a7f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:24.941892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1255/2503] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:24.945993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ef2d-2c76-48ab-99bf-b4c15745c42e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:24.956038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ef2d-2c76-48ab-99bf-b4c15745c42e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:24.961394 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:24.962017 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:24.962295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:24.962567 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:24.963211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:18:24.963512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:24.965102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:24.978199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1249/2504] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:18:24.982447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222be0a-4599-4117-9604-d06287a7f3f0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:24.993472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222be0a-4599-4117-9604-d06287a7f3f0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:24.998106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e49b5-0de0-4b43-aac5-7e973efe3dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:24.998699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e49b5-0de0-4b43-aac5-7e973efe3dce admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:24.998978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e49b5-0de0-4b43-aac5-7e973efe3dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:24.999251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e49b5-0de0-4b43-aac5-7e973efe3dce admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:24.999873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e49b5-0de0-4b43-aac5-7e973efe3dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:25.001798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e49b5-0de0-4b43-aac5-7e973efe3dce admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:25.028724 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1256/2505] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:18:24 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:25.033070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:25.043734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fb84f-ea61-4e0b-b3b5-9bd450f1b8d9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:25.098317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603f443-dc1b-47c1-8782-c32764a3464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:25.098911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603f443-dc1b-47c1-8782-c32764a3464a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:25.099188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603f443-dc1b-47c1-8782-c32764a3464a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:25.099455 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603f443-dc1b-47c1-8782-c32764a3464a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:25.100067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603f443-dc1b-47c1-8782-c32764a3464a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:25.102590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603f443-dc1b-47c1-8782-c32764a3464a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:25.123038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1250/2506] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:18:25 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:25.127143 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e49b5-0de0-4b43-aac5-7e973efe3dce admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:25.137496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e49b5-0de0-4b43-aac5-7e973efe3dce admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:25.142006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e48fa-67a8-49b7-998a-7a593ffc18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:25.142591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e48fa-67a8-49b7-998a-7a593ffc18bd admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:25.142868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e48fa-67a8-49b7-998a-7a593ffc18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:25.143137 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e48fa-67a8-49b7-998a-7a593ffc18bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:25.143775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e48fa-67a8-49b7-998a-7a593ffc18bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:25.145357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e48fa-67a8-49b7-998a-7a593ffc18bd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:25.155849 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1257/2507] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:25.159571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603f443-dc1b-47c1-8782-c32764a3464a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:25.170020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603f443-dc1b-47c1-8782-c32764a3464a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:25.174721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6f251-7cb8-464a-8a46-1aa318d5eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:25.175313 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6f251-7cb8-464a-8a46-1aa318d5eb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:25.175592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6f251-7cb8-464a-8a46-1aa318d5eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:25.175864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6f251-7cb8-464a-8a46-1aa318d5eb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:25.176550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6f251-7cb8-464a-8a46-1aa318d5eb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:25.178175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6f251-7cb8-464a-8a46-1aa318d5eb5d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:25.189031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1251/2508] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:18:25.193205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e48fa-67a8-49b7-998a-7a593ffc18bd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:25.203138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e48fa-67a8-49b7-998a-7a593ffc18bd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:25.207949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:25.208618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:25.208900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:25.209175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] PATH_INFO: `/v3/projects/9d31084b92674a2f99292f20c48829f6/users/38da2b367a334855a5bb6b0af0626c19/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:25.224978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d31084b92674a2f99292f20c48829f6, user_id=38da2b367a334855a5bb6b0af0626c19, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:25.228700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:25.242296 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1258/2509] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:25 2022] PUT /identity/v3/projects/9d31084b92674a2f99292f20c48829f6/users/38da2b367a334855a5bb6b0af0626c19/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:25.248971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91671e-bd3c-473e-b67a-4d69b73a1304 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:25.249344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91671e-bd3c-473e-b67a-4d69b73a1304 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:25.249830 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91671e-bd3c-473e-b67a-4d69b73a1304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:25.257775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:25.271159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-af91671e-bd3c-473e-b67a-4d69b73a1304 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:25.272377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-af91671e-bd3c-473e-b67a-4d69b73a1304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:25.335106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1252/2510] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:25.345161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:25.346921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:25.404116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87f9ad-c958-4282-a599-0b72c452c122 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:25.408017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65c072-8f4c-427f-973a-3b2a9ed7da19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:25.408615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65c072-8f4c-427f-973a-3b2a9ed7da19 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:25.408895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65c072-8f4c-427f-973a-3b2a9ed7da19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:25.409171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65c072-8f4c-427f-973a-3b2a9ed7da19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:25.415089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:25.419791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65c072-8f4c-427f-973a-3b2a9ed7da19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:25.421283 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65c072-8f4c-427f-973a-3b2a9ed7da19 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:25.431464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1259/2511] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:26.034933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff26bd-670e-4511-b82e-48d1db99d8db None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:26.035453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff26bd-670e-4511-b82e-48d1db99d8db None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:26.035551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff26bd-670e-4511-b82e-48d1db99d8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:26.065192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2eff26bd-670e-4511-b82e-48d1db99d8db None None] MFA Rules not processed for user `38da2b367a334855a5bb6b0af0626c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:26.066590 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2eff26bd-670e-4511-b82e-48d1db99d8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:26.134974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1253/2512] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:26.139581 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65c072-8f4c-427f-973a-3b2a9ed7da19 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:26.149735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65c072-8f4c-427f-973a-3b2a9ed7da19 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:26.154353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f0d5-6405-42f5-9160-51b0b5f51c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:26.154971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f0d5-6405-42f5-9160-51b0b5f51c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:26.155251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f0d5-6405-42f5-9160-51b0b5f51c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:26.155527 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f0d5-6405-42f5-9160-51b0b5f51c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:26.156181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62f0d5-6405-42f5-9160-51b0b5f51c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:26.158158 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62f0d5-6405-42f5-9160-51b0b5f51c7a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:26.190858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1260/2513] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:18:26 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:26.192007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff26bd-670e-4511-b82e-48d1db99d8db None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:26.203413 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff26bd-670e-4511-b82e-48d1db99d8db None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:26.262221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e00f6-2f3d-4f31-bab2-0eeef6706351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:26.262849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e00f6-2f3d-4f31-bab2-0eeef6706351 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:26.263132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e00f6-2f3d-4f31-bab2-0eeef6706351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:26.263402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e00f6-2f3d-4f31-bab2-0eeef6706351 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:26.264039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e00f6-2f3d-4f31-bab2-0eeef6706351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:26.266013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e00f6-2f3d-4f31-bab2-0eeef6706351 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:26.288963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1254/2514] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:18:26 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:26.292923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f0d5-6405-42f5-9160-51b0b5f51c7a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:26.303124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f0d5-6405-42f5-9160-51b0b5f51c7a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:26.308062 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4905d-8e46-4c29-b1d7-91b15212a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:26.308669 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4905d-8e46-4c29-b1d7-91b15212a4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:26.308980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4905d-8e46-4c29-b1d7-91b15212a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:26.309258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4905d-8e46-4c29-b1d7-91b15212a4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:26.309995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4905d-8e46-4c29-b1d7-91b15212a4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:26.311610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4905d-8e46-4c29-b1d7-91b15212a4b7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:26.326063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1261/2515] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:26.327288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e00f6-2f3d-4f31-bab2-0eeef6706351 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:26.338518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e00f6-2f3d-4f31-bab2-0eeef6706351 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:26.343438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3c5f-2345-4103-a442-4d4c51f5b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:26.344125 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3c5f-2345-4103-a442-4d4c51f5b49c admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:26.344408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3c5f-2345-4103-a442-4d4c51f5b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:26.344678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3c5f-2345-4103-a442-4d4c51f5b49c admin admin] PATH_INFO: `/v3/projects/f43b8ac495b74faf83be6ca895208aa2/users/4bb804761bd44b21b03d8a184d8dc4b7/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:26.363557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d3c5f-2345-4103-a442-4d4c51f5b49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43b8ac495b74faf83be6ca895208aa2, user_id=4bb804761bd44b21b03d8a184d8dc4b7, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:26.366437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d3c5f-2345-4103-a442-4d4c51f5b49c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:26.374732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:26.381704 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1255/2516] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:26 2022] PUT /identity/v3/projects/f43b8ac495b74faf83be6ca895208aa2/users/4bb804761bd44b21b03d8a184d8dc4b7/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:26.386036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4905d-8e46-4c29-b1d7-91b15212a4b7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:26.396228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4905d-8e46-4c29-b1d7-91b15212a4b7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:26.454274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5980e-a19a-4f05-b140-02cff0dbceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:26.454896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5980e-a19a-4f05-b140-02cff0dbceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:26.455181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5980e-a19a-4f05-b140-02cff0dbceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:26.455461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5980e-a19a-4f05-b140-02cff0dbceb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:26.456106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5980e-a19a-4f05-b140-02cff0dbceb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:26.457847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5980e-a19a-4f05-b140-02cff0dbceb3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:26.469606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1262/2517] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:26.474093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3c5f-2345-4103-a442-4d4c51f5b49c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:26.484923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3c5f-2345-4103-a442-4d4c51f5b49c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:26.489663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fdd13-9320-49f1-8a7b-a21e11a54daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:26.490317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fdd13-9320-49f1-8a7b-a21e11a54daa admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:26.490595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fdd13-9320-49f1-8a7b-a21e11a54daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:26.490867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fdd13-9320-49f1-8a7b-a21e11a54daa admin admin] PATH_INFO: `/v3/projects/f43b8ac495b74faf83be6ca895208aa2/users/4bb804761bd44b21b03d8a184d8dc4b7/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:26.493346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fdd13-9320-49f1-8a7b-a21e11a54daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43b8ac495b74faf83be6ca895208aa2, user_id=4bb804761bd44b21b03d8a184d8dc4b7, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:26.495995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fdd13-9320-49f1-8a7b-a21e11a54daa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:26.518004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1256/2518] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:26 2022] PUT /identity/v3/projects/f43b8ac495b74faf83be6ca895208aa2/users/4bb804761bd44b21b03d8a184d8dc4b7/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:27.130155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7c23-5fb8-4faa-89ae-a49a8968384e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:27.130477 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7c23-5fb8-4faa-89ae-a49a8968384e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:27.130750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c7c23-5fb8-4faa-89ae-a49a8968384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:27.161712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ce3c7c23-5fb8-4faa-89ae-a49a8968384e None None] MFA Rules not processed for user `4bb804761bd44b21b03d8a184d8dc4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:27.162966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ce3c7c23-5fb8-4faa-89ae-a49a8968384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:27.233156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1263/2519] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:27.245282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455fc2-a8e8-4b8c-9477-ac7de17868bf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:27.247286 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455fc2-a8e8-4b8c-9477-ac7de17868bf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:27.247572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455fc2-a8e8-4b8c-9477-ac7de17868bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:27.268833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c0455fc2-a8e8-4b8c-9477-ac7de17868bf None None] MFA Rules not processed for user `38da2b367a334855a5bb6b0af0626c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:27.270060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c0455fc2-a8e8-4b8c-9477-ac7de17868bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:27.326066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1257/2520] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:27.337261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c7c23-5fb8-4faa-89ae-a49a8968384e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:27.338753 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ce3c7c23-5fb8-4faa-89ae-a49a8968384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:27.384430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:27.412233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c7c23-5fb8-4faa-89ae-a49a8968384e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:27.417675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92ac1d-dfbd-42ad-a894-73a6fd66952d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:27.418278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ac1d-dfbd-42ad-a894-73a6fd66952d service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:27.418557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ac1d-dfbd-42ad-a894-73a6fd66952d service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:27.418835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92ac1d-dfbd-42ad-a894-73a6fd66952d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:27.426604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92ac1d-dfbd-42ad-a894-73a6fd66952d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:27.428248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92ac1d-dfbd-42ad-a894-73a6fd66952d service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:27.437436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1264/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:31.437787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0455fc2-a8e8-4b8c-9477-ac7de17868bf None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:31.439189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c0455fc2-a8e8-4b8c-9477-ac7de17868bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:31.496735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0455fc2-a8e8-4b8c-9477-ac7de17868bf None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:31.500297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:31.500900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:31.501178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:31.501469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:31.503472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:31.564327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:31.565907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:31.575707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1258/2522] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:32.267842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabf090-1515-4db5-b259-c6da1e137c3a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:32.268313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabf090-1515-4db5-b259-c6da1e137c3a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:32.268391 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabf090-1515-4db5-b259-c6da1e137c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:32.290241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3eabf090-1515-4db5-b259-c6da1e137c3a None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:32.291793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3eabf090-1515-4db5-b259-c6da1e137c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:32.360848 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1265/2523] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:32.382514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:32.384374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:32.456686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:32.483701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f0b2a-19b0-42f5-80c6-e5eda9d735e7 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:32.488788 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:32.489391 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:32.489697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:32.489971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:32.499802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:32.501431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:32.513454 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1259/2524] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:18:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:18:42.290578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabf090-1515-4db5-b259-c6da1e137c3a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:42.292159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3eabf090-1515-4db5-b259-c6da1e137c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:42.304414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabf090-1515-4db5-b259-c6da1e137c3a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:42.308169 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a94eaa-d0b3-490b-a849-30eaeb6a31de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:42.308775 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a94eaa-d0b3-490b-a849-30eaeb6a31de service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:42.309058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a94eaa-d0b3-490b-a849-30eaeb6a31de service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:42.309339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a94eaa-d0b3-490b-a849-30eaeb6a31de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:42.318555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a94eaa-d0b3-490b-a849-30eaeb6a31de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:42.320582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a94eaa-d0b3-490b-a849-30eaeb6a31de service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:42.330396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1266/2525] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:42.465573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:42.467026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:42.482780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c56b-78ee-4504-ab67-0e8a615245d9 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:42.488198 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc285736-78a9-4ee0-b87e-d4bea867ec6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:42.488783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc285736-78a9-4ee0-b87e-d4bea867ec6c service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:42.489061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc285736-78a9-4ee0-b87e-d4bea867ec6c service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:42.489338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc285736-78a9-4ee0-b87e-d4bea867ec6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:42.491650 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dc285736-78a9-4ee0-b87e-d4bea867ec6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:42.554959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc285736-78a9-4ee0-b87e-d4bea867ec6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:42.556556 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc285736-78a9-4ee0-b87e-d4bea867ec6c service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:42.566158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1260/2526] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:49.755574 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae70da-fe65-47dd-8616-7a23f506ab62 None None] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:49.756755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae70da-fe65-47dd-8616-7a23f506ab62 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:49.756755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae70da-fe65-47dd-8616-7a23f506ab62 None None] PATH_INFO: `/` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:49.758161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1267/2527] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:18:49.764305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88206ce-33b6-4b76-9dde-dea5df52562a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:49.764781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88206ce-33b6-4b76-9dde-dea5df52562a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:49.764888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88206ce-33b6-4b76-9dde-dea5df52562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:49.784529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a88206ce-33b6-4b76-9dde-dea5df52562a None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:49.785781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a88206ce-33b6-4b76-9dde-dea5df52562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:49.795572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1261/2528] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:18:49.807596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae70da-fe65-47dd-8616-7a23f506ab62 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:49.809757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6cae70da-fe65-47dd-8616-7a23f506ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:49.877337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae70da-fe65-47dd-8616-7a23f506ab62 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:49.881500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15dbf2-98a0-4e8c-940b-e417cc5e2918 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d637726e3142e6ba90fa201c764b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:49.882662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15dbf2-98a0-4e8c-940b-e417cc5e2918 service glance] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:49.882662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15dbf2-98a0-4e8c-940b-e417cc5e2918 service glance] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:49.882662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15dbf2-98a0-4e8c-940b-e417cc5e2918 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:49.894007 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15dbf2-98a0-4e8c-940b-e417cc5e2918 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:49.895434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15dbf2-98a0-4e8c-940b-e417cc5e2918 service glance] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:49.906796 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1268/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:49.975395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff9507-430c-4fa8-a91b-2c29978154a0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:49.975800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff9507-430c-4fa8-a91b-2c29978154a0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:49.976302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff9507-430c-4fa8-a91b-2c29978154a0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:49.977836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1262/2530] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:18:49.983355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e016b-894b-4ed9-972f-e0f222abec8f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:49.983713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e016b-894b-4ed9-972f-e0f222abec8f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:49.984082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e016b-894b-4ed9-972f-e0f222abec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:50.008828 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-d76e016b-894b-4ed9-972f-e0f222abec8f None None] MFA Rules not processed for user `5a6ff1b9371a411bae7b3e45f78e05e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:50.010192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d76e016b-894b-4ed9-972f-e0f222abec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:50.067061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1269/2531] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:50.081672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff9507-430c-4fa8-a91b-2c29978154a0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:50.092801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff9507-430c-4fa8-a91b-2c29978154a0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:50.096659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:50.097263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:50.097597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:50.097876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:50.106138 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:50.107758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:50.116312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1263/2532] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:50.514288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e016b-894b-4ed9-972f-e0f222abec8f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:50.515716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d76e016b-894b-4ed9-972f-e0f222abec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:50.529849 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:50.586944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e016b-894b-4ed9-972f-e0f222abec8f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:50.592241 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:50.592852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:50.593166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:50.593465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:50.595182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:50.607395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:50.608962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:50.619812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1270/2533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:51.650538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:51.652061 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:51.663940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d147-094a-46c4-9a6f-98de0967b9db service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:51.667563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe445-bb60-4ca7-b003-0327940b9fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:51.668150 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe445-bb60-4ca7-b003-0327940b9fca service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:51.668432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe445-bb60-4ca7-b003-0327940b9fca service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:51.668701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe445-bb60-4ca7-b003-0327940b9fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:51.670387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-95cbe445-bb60-4ca7-b003-0327940b9fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:51.680175 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbe445-bb60-4ca7-b003-0327940b9fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:51.681626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbe445-bb60-4ca7-b003-0327940b9fca service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:51.689482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1264/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:52.422252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:52.431671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240352-ccdb-483b-9d6e-386a072f47b2 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:52.435220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:52.435809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:52.436088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:52.436361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:52.438191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:52.501841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:52.503564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:52.515065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1271/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:18:52.574077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd73c66-1666-4ce7-ad45-3b1e0ef05130 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:52.574437 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd73c66-1666-4ce7-ad45-3b1e0ef05130 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:52.574723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd73c66-1666-4ce7-ad45-3b1e0ef05130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:52.594303 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5fd73c66-1666-4ce7-ad45-3b1e0ef05130 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:52.595610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5fd73c66-1666-4ce7-ad45-3b1e0ef05130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:52.605578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1265/2536] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:52.618912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:52.630660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2339f-8253-47d7-a9c3-c86460d6847f service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:52.636282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfaea-3121-4dbf-8bfd-95eca2bae70b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:52.636889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfaea-3121-4dbf-8bfd-95eca2bae70b service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:52.637173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfaea-3121-4dbf-8bfd-95eca2bae70b service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:52.637478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfaea-3121-4dbf-8bfd-95eca2bae70b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:52.646266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bfaea-3121-4dbf-8bfd-95eca2bae70b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:52.648032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bfaea-3121-4dbf-8bfd-95eca2bae70b service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:52.656186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1272/2537] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:18:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:18:56.842443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd73c66-1666-4ce7-ad45-3b1e0ef05130 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:56.844044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5fd73c66-1666-4ce7-ad45-3b1e0ef05130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:56.871758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd73c66-1666-4ce7-ad45-3b1e0ef05130 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:56.879242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:56.880211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:56.880886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:56.881662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] PATH_INFO: `/v3/users/e67e4e9e8c2c41c68dd7dd92a3297e93` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:56.883323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67e4e9e8c2c41c68dd7dd92a3297e93)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:56.886682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:56.975042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67e4e9e8c2c41c68dd7dd92a3297e93'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:56.988844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67e4e9e8c2c41c68dd7dd92a3297e93'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.017046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67e4e9e8c2c41c68dd7dd92a3297e93'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.018561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67e4e9e8c2c41c68dd7dd92a3297e93'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.030405 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5617b95f-01c3-4db1-a624-249f3d27e6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67e4e9e8c2c41c68dd7dd92a3297e93'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.038465 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1266/2538] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:18:56 2022] DELETE /identity/v3/users/e67e4e9e8c2c41c68dd7dd92a3297e93 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:57.337437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfaea-3121-4dbf-8bfd-95eca2bae70b service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:57.352642 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfaea-3121-4dbf-8bfd-95eca2bae70b service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:57.473990 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:57.475835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:57.476173 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:57.476744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] PATH_INFO: `/v3/projects/5247b740ac8c4a04808432284961f40c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:57.478087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5247b740ac8c4a04808432284961f40c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:57.480211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:57.519835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:57.558668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5247b740ac8c4a04808432284961f40c', 'request_id': 'req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.575376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5247b740ac8c4a04808432284961f40c', 'request_id': 'req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.597533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5247b740ac8c4a04808432284961f40c', 'request_id': 'req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.609750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] The token cache is being invalidate because project 5247b740ac8c4a04808432284961f40c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:18:57.610020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.610697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-26cfb19f-7cc9-4dad-91fa-53eb06dc15bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:18:57.612491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1273/2539] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:18:57 2022] DELETE /identity/v3/projects/5247b740ac8c4a04808432284961f40c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:18:57.617561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0392d-8c17-45a1-9779-15e9779ffdb3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:57.617751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0392d-8c17-45a1-9779-15e9779ffdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:57.618015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0392d-8c17-45a1-9779-15e9779ffdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:57.628296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:57.650591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-45d0392d-8c17-45a1-9779-15e9779ffdb3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:57.652090 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-45d0392d-8c17-45a1-9779-15e9779ffdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:57.742095 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1267/2540] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:57.751153 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb523-ac92-4a03-b962-4c2f0829440f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:57.751436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb523-ac92-4a03-b962-4c2f0829440f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:57.751710 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb523-ac92-4a03-b962-4c2f0829440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:57.788338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b7fdb523-ac92-4a03-b962-4c2f0829440f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:57.789594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b7fdb523-ac92-4a03-b962-4c2f0829440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:57.798238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1274/2541] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:57.803171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0392d-8c17-45a1-9779-15e9779ffdb3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:57.814165 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0392d-8c17-45a1-9779-15e9779ffdb3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:57.820060 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:57.820683 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:57.820968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:57.821245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:57.821938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:18:57.822245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:57.823992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:57.844164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1268/2542] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:18:57.845192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdb523-ac92-4a03-b962-4c2f0829440f None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:57.854418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdb523-ac92-4a03-b962-4c2f0829440f None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:57.859122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7d7a0-7219-4ef9-9012-4e367f1e1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:57.859721 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d7a0-7219-4ef9-9012-4e367f1e1821 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:57.860119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d7a0-7219-4ef9-9012-4e367f1e1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:57.860399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d7a0-7219-4ef9-9012-4e367f1e1821 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:57.861090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7d7a0-7219-4ef9-9012-4e367f1e1821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:57.863346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7d7a0-7219-4ef9-9012-4e367f1e1821 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:57.928245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1275/2543] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:18:57 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:57.929440 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:57.942044 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe0a71-9ba3-4ab8-af4b-6e8750188e4f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:58.041841 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdd4ea-0c81-4640-a0c5-8533ee5df747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:58.043000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd4ea-0c81-4640-a0c5-8533ee5df747 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:58.043559 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd4ea-0c81-4640-a0c5-8533ee5df747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:58.044103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd4ea-0c81-4640-a0c5-8533ee5df747 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:58.045168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdd4ea-0c81-4640-a0c5-8533ee5df747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:58.047725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdd4ea-0c81-4640-a0c5-8533ee5df747 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:58.121031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1269/2544] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:18:57 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:18:58.125472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7d7a0-7219-4ef9-9012-4e367f1e1821 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:58.139754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7d7a0-7219-4ef9-9012-4e367f1e1821 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:58.159017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791d359-9a60-4bc2-99e3-f89460c0c66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:58.159650 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791d359-9a60-4bc2-99e3-f89460c0c66a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:58.159935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791d359-9a60-4bc2-99e3-f89460c0c66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:58.160208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791d359-9a60-4bc2-99e3-f89460c0c66a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:58.160867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791d359-9a60-4bc2-99e3-f89460c0c66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:58.162568 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791d359-9a60-4bc2-99e3-f89460c0c66a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:58.176065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1276/2545] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:58.180727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdd4ea-0c81-4640-a0c5-8533ee5df747 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:58.191597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdd4ea-0c81-4640-a0c5-8533ee5df747 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:58.198154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22895aae-0348-493b-870b-91f836ca15fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:58.198933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895aae-0348-493b-870b-91f836ca15fc admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:58.199219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895aae-0348-493b-870b-91f836ca15fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:58.199505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22895aae-0348-493b-870b-91f836ca15fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:58.200240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22895aae-0348-493b-870b-91f836ca15fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:58.201909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22895aae-0348-493b-870b-91f836ca15fc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:58.215131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1270/2546] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:18:58.219627 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791d359-9a60-4bc2-99e3-f89460c0c66a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:58.232826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791d359-9a60-4bc2-99e3-f89460c0c66a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:58.237613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:58.238277 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:58.238559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:58.238836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] PATH_INFO: `/v3/projects/f9f749d8dd1d4fe2a7f651b86146e58a/users/df15253298d74e8e85fc3d8b1fd0f6a4/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:58.254840 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f749d8dd1d4fe2a7f651b86146e58a, user_id=df15253298d74e8e85fc3d8b1fd0f6a4, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:58.258456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:58.276927 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1277/2547] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:18:58 2022] PUT /identity/v3/projects/f9f749d8dd1d4fe2a7f651b86146e58a/users/df15253298d74e8e85fc3d8b1fd0f6a4/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:18:58.288156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8218a-a4b0-4d03-99b2-24d271f2bc8d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:58.288468 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8218a-a4b0-4d03-99b2-24d271f2bc8d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:58.288765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8218a-a4b0-4d03-99b2-24d271f2bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:58.319538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c6d8218a-a4b0-4d03-99b2-24d271f2bc8d None None] MFA Rules not processed for user `df15253298d74e8e85fc3d8b1fd0f6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:18:58.321501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c6d8218a-a4b0-4d03-99b2-24d271f2bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:58.402123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:58.409291 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1271/2548] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:18:58.420729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:18:58.422831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:18:58.494116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417b485-5df1-4b5e-a80d-6b5c4058da4c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:18:58.499147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb22d91-8f2b-4011-b2e4-3fcd9939f282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:18:58.500095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb22d91-8f2b-4011-b2e4-3fcd9939f282 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:18:58.500530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb22d91-8f2b-4011-b2e4-3fcd9939f282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:18:58.501345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb22d91-8f2b-4011-b2e4-3fcd9939f282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:18:58.513118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb22d91-8f2b-4011-b2e4-3fcd9939f282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:18:58.514755 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb22d91-8f2b-4011-b2e4-3fcd9939f282 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:18:58.525725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1278/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:18:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:05.691265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8218a-a4b0-4d03-99b2-24d271f2bc8d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:05.692886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c6d8218a-a4b0-4d03-99b2-24d271f2bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:05.757706 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8218a-a4b0-4d03-99b2-24d271f2bc8d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:05.762298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:05.762919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:05.763196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:05.763466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] PATH_INFO: `/v3/users/38da2b367a334855a5bb6b0af0626c19` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:05.764569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38da2b367a334855a5bb6b0af0626c19)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:05.766512 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:05.814156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38da2b367a334855a5bb6b0af0626c19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:05.821787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38da2b367a334855a5bb6b0af0626c19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:05.834497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38da2b367a334855a5bb6b0af0626c19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:05.835133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38da2b367a334855a5bb6b0af0626c19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:05.842103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38da2b367a334855a5bb6b0af0626c19'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:05.848323 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1272/2550] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:05 2022] DELETE /identity/v3/users/38da2b367a334855a5bb6b0af0626c19 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:06.099165 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb22d91-8f2b-4011-b2e4-3fcd9939f282 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:06.122999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb22d91-8f2b-4011-b2e4-3fcd9939f282 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:06.178678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:06.190282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:06.190914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:06.191194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:06.191464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] PATH_INFO: `/v3/projects/9d31084b92674a2f99292f20c48829f6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:06.192652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d31084b92674a2f99292f20c48829f6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:06.195269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:06.242704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d31084b92674a2f99292f20c48829f6', 'request_id': 'req-54f83a9f-e298-42f3-bb01-157116e71ab4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.249377 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d31084b92674a2f99292f20c48829f6', 'request_id': 'req-54f83a9f-e298-42f3-bb01-157116e71ab4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.256305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d31084b92674a2f99292f20c48829f6', 'request_id': 'req-54f83a9f-e298-42f3-bb01-157116e71ab4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.267740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] The token cache is being invalidate because project 9d31084b92674a2f99292f20c48829f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:06.268029 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.268662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.270188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1279/2551] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:06 2022] DELETE /identity/v3/projects/9d31084b92674a2f99292f20c48829f6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:06.274154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:06.275550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:06.289991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89138bc7-7513-40e5-8553-0a54f0935509 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:06.346435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:06.347089 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:06.347378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:06.347636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] PATH_INFO: `/v3/users/4bb804761bd44b21b03d8a184d8dc4b7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:06.348781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb804761bd44b21b03d8a184d8dc4b7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:06.350762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:06.374038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:06.403878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb804761bd44b21b03d8a184d8dc4b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.411480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb804761bd44b21b03d8a184d8dc4b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.423332 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb804761bd44b21b03d8a184d8dc4b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.424003 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb804761bd44b21b03d8a184d8dc4b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.431676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6cefcb10-f408-41a6-afa1-3018f4fcf2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb804761bd44b21b03d8a184d8dc4b7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.438136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1273/2552] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:06 2022] DELETE /identity/v3/users/4bb804761bd44b21b03d8a184d8dc4b7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:06.619108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:06.620666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:06.634789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f83a9f-e298-42f3-bb01-157116e71ab4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:06.695939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:06.696578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:06.696869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:06.697145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] PATH_INFO: `/v3/projects/f43b8ac495b74faf83be6ca895208aa2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:06.698311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43b8ac495b74faf83be6ca895208aa2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:06.700274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:06.751517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43b8ac495b74faf83be6ca895208aa2', 'request_id': 'req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.759439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43b8ac495b74faf83be6ca895208aa2', 'request_id': 'req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.765450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43b8ac495b74faf83be6ca895208aa2', 'request_id': 'req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.777420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] The token cache is being invalidate because project f43b8ac495b74faf83be6ca895208aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:06.777715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.778364 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b0277b-9fa4-4f02-a693-44dd34ebc8d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:06.780133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1280/2553] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:06 2022] DELETE /identity/v3/projects/f43b8ac495b74faf83be6ca895208aa2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:06.785008 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fde96-7bf8-489c-af9f-914569bfc253 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:06.785570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fde96-7bf8-489c-af9f-914569bfc253 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:06.785570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fde96-7bf8-489c-af9f-914569bfc253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:06.807579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-910fde96-7bf8-489c-af9f-914569bfc253 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:06.808863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-910fde96-7bf8-489c-af9f-914569bfc253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:06.870957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1274/2554] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:06.879034 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d0db-8f34-467a-b995-582907775ff9 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:06.879319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d0db-8f34-467a-b995-582907775ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:06.879592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d0db-8f34-467a-b995-582907775ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:06.898843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3168d0db-8f34-467a-b995-582907775ff9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:06.900031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3168d0db-8f34-467a-b995-582907775ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:06.908002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1281/2555] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:06.912653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fde96-7bf8-489c-af9f-914569bfc253 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:06.922252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fde96-7bf8-489c-af9f-914569bfc253 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:06.926808 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:06.927975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:06.928251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:06.928521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:06.929164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:06.929495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:06.931114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:06.942720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1275/2556] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:06.946856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d0db-8f34-467a-b995-582907775ff9 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:06.952405 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:06.956570 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d0db-8f34-467a-b995-582907775ff9 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:06.963651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4a66-23be-41f1-8cd3-30c819e0d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:06.964424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4a66-23be-41f1-8cd3-30c819e0d0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:06.964864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4a66-23be-41f1-8cd3-30c819e0d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:06.965199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4a66-23be-41f1-8cd3-30c819e0d0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:06.966111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec4a66-23be-41f1-8cd3-30c819e0d0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:06.968047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec4a66-23be-41f1-8cd3-30c819e0d0ee admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:06.995798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1282/2557] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:06 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:06.999959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.010295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56498c-958e-4add-b630-e2b147cdd2ac admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.066180 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61691173-7592-4344-b67f-7a2bcdb48d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.066720 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691173-7592-4344-b67f-7a2bcdb48d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.067001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691173-7592-4344-b67f-7a2bcdb48d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.067274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691173-7592-4344-b67f-7a2bcdb48d92 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.067910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61691173-7592-4344-b67f-7a2bcdb48d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.069890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61691173-7592-4344-b67f-7a2bcdb48d92 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.091166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1276/2558] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:06 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:07.095334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4a66-23be-41f1-8cd3-30c819e0d0ee admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.106160 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4a66-23be-41f1-8cd3-30c819e0d0ee admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.110858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1ddc-f067-46cb-be45-3d054f43f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.111456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1ddc-f067-46cb-be45-3d054f43f19e admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.111746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1ddc-f067-46cb-be45-3d054f43f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.112019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1ddc-f067-46cb-be45-3d054f43f19e admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.112656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1ddc-f067-46cb-be45-3d054f43f19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.114304 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1ddc-f067-46cb-be45-3d054f43f19e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.124172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1283/2559] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:07.128642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61691173-7592-4344-b67f-7a2bcdb48d92 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.139548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61691173-7592-4344-b67f-7a2bcdb48d92 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.144081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.144669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.144947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.145217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.146386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.147966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.159634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1277/2560] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:07.164461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1ddc-f067-46cb-be45-3d054f43f19e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.174695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1ddc-f067-46cb-be45-3d054f43f19e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.179523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cd1b7-1871-431f-a543-a754d8e1fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.180182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cd1b7-1871-431f-a543-a754d8e1fc73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.180465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cd1b7-1871-431f-a543-a754d8e1fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.180743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cd1b7-1871-431f-a543-a754d8e1fc73 admin admin] PATH_INFO: `/v3/projects/ccc22ba6dc244a1aa7b8639555e5a1d1/users/67f4dc8e0cd8461d9b8eb5fe1ad04998/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.184968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.186667 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:07.196593 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:07.196790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cd1b7-1871-431f-a543-a754d8e1fc73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc22ba6dc244a1aa7b8639555e5a1d1, user_id=67f4dc8e0cd8461d9b8eb5fe1ad04998, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.199484 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cd1b7-1871-431f-a543-a754d8e1fc73 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.201244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fced5-a305-4780-9057-0b111ecb0e62 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.208219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.209918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.211018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.212206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] PATH_INFO: `/v3/users/df15253298d74e8e85fc3d8b1fd0f6a4` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.213157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df15253298d74e8e85fc3d8b1fd0f6a4)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.215549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1284/2561] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:07 2022] PUT /identity/v3/projects/ccc22ba6dc244a1aa7b8639555e5a1d1/users/67f4dc8e0cd8461d9b8eb5fe1ad04998/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:07.222734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.230315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60166-0cf3-4a11-9a0e-24fb09c818f5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.232382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60166-0cf3-4a11-9a0e-24fb09c818f5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.233065 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e60166-0cf3-4a11-9a0e-24fb09c818f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.271372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-77e60166-0cf3-4a11-9a0e-24fb09c818f5 None None] MFA Rules not processed for user `67f4dc8e0cd8461d9b8eb5fe1ad04998`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:07.272646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-77e60166-0cf3-4a11-9a0e-24fb09c818f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:07.290623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df15253298d74e8e85fc3d8b1fd0f6a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:07.299133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df15253298d74e8e85fc3d8b1fd0f6a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:07.314783 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df15253298d74e8e85fc3d8b1fd0f6a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:07.315538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df15253298d74e8e85fc3d8b1fd0f6a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:07.323255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-57b4e6f5-a9ad-44f5-9c23-99ec5a436d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df15253298d74e8e85fc3d8b1fd0f6a4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:07.334312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1278/2562] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:07 2022] DELETE /identity/v3/users/df15253298d74e8e85fc3d8b1fd0f6a4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:07.338617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895230ed-b181-4858-905b-da111d12c308 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.338975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895230ed-b181-4858-905b-da111d12c308 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.339319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895230ed-b181-4858-905b-da111d12c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.358034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-895230ed-b181-4858-905b-da111d12c308 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:07.359248 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-895230ed-b181-4858-905b-da111d12c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:07.362760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1285/2563] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:07.367316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60166-0cf3-4a11-9a0e-24fb09c818f5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.368731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-77e60166-0cf3-4a11-9a0e-24fb09c818f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:07.421986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1279/2564] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:07.431922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895230ed-b181-4858-905b-da111d12c308 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.433265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-895230ed-b181-4858-905b-da111d12c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:07.434605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e60166-0cf3-4a11-9a0e-24fb09c818f5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.439270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d76aa-9df3-471a-9588-2d96b9b3aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.439882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d76aa-9df3-471a-9588-2d96b9b3aa92 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.440170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d76aa-9df3-471a-9588-2d96b9b3aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.440448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d76aa-9df3-471a-9588-2d96b9b3aa92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.441087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d76aa-9df3-471a-9588-2d96b9b3aa92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.443549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d76aa-9df3-471a-9588-2d96b9b3aa92 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.472761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1286/2565] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:07 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:07.476764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d76aa-9df3-471a-9588-2d96b9b3aa92 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.491916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895230ed-b181-4858-905b-da111d12c308 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.503936 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:07.524982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:07.547325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584c977-ac13-4c8c-8290-5431fc1801ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.547787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d76aa-9df3-471a-9588-2d96b9b3aa92 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.547933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584c977-ac13-4c8c-8290-5431fc1801ae service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.548212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584c977-ac13-4c8c-8290-5431fc1801ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.548482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584c977-ac13-4c8c-8290-5431fc1801ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.552554 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6fbf6-1ff9-4813-8cb9-3412d805f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.553181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6fbf6-1ff9-4813-8cb9-3412d805f54c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.553503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6fbf6-1ff9-4813-8cb9-3412d805f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.553785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6fbf6-1ff9-4813-8cb9-3412d805f54c admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.554425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6fbf6-1ff9-4813-8cb9-3412d805f54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.556365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6fbf6-1ff9-4813-8cb9-3412d805f54c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.559716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584c977-ac13-4c8c-8290-5431fc1801ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.561875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584c977-ac13-4c8c-8290-5431fc1801ae service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.573721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1280/2566] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:19:07.579592 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1287/2567] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:07 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:07.584137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584c977-ac13-4c8c-8290-5431fc1801ae service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.593918 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584c977-ac13-4c8c-8290-5431fc1801ae service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.598659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788969-7cca-4434-a3d0-5d525c68ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.599373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788969-7cca-4434-a3d0-5d525c68ca01 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.599656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788969-7cca-4434-a3d0-5d525c68ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.600135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788969-7cca-4434-a3d0-5d525c68ca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.600809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e788969-7cca-4434-a3d0-5d525c68ca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.602436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e788969-7cca-4434-a3d0-5d525c68ca01 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.614258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1281/2568] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:07.618999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6fbf6-1ff9-4813-8cb9-3412d805f54c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.629821 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6fbf6-1ff9-4813-8cb9-3412d805f54c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.635505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038e825-3c9c-45e2-ae22-66ccd7b3b967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.636155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038e825-3c9c-45e2-ae22-66ccd7b3b967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.636442 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038e825-3c9c-45e2-ae22-66ccd7b3b967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.636718 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038e825-3c9c-45e2-ae22-66ccd7b3b967 admin admin] PATH_INFO: `/v3/projects/8175c2b390e44d1ea0a32ff4d78da138/users/d41a0ccf8c0d486f8b03f9789a7c348f/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.652772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038e825-3c9c-45e2-ae22-66ccd7b3b967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8175c2b390e44d1ea0a32ff4d78da138, user_id=d41a0ccf8c0d486f8b03f9789a7c348f, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.655616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038e825-3c9c-45e2-ae22-66ccd7b3b967 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.670597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1288/2569] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:07 2022] PUT /identity/v3/projects/8175c2b390e44d1ea0a32ff4d78da138/users/d41a0ccf8c0d486f8b03f9789a7c348f/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:07.674950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788969-7cca-4434-a3d0-5d525c68ca01 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.686436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788969-7cca-4434-a3d0-5d525c68ca01 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.749390 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290ee78-a58c-48ad-ae4c-e7127f400565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.750031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290ee78-a58c-48ad-ae4c-e7127f400565 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.750312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290ee78-a58c-48ad-ae4c-e7127f400565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.750585 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290ee78-a58c-48ad-ae4c-e7127f400565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.751227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290ee78-a58c-48ad-ae4c-e7127f400565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.753086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290ee78-a58c-48ad-ae4c-e7127f400565 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.763993 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1282/2570] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:07.768345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038e825-3c9c-45e2-ae22-66ccd7b3b967 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.778958 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038e825-3c9c-45e2-ae22-66ccd7b3b967 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.783708 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.784363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.784644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.784919 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] PATH_INFO: `/v3/projects/8175c2b390e44d1ea0a32ff4d78da138/users/d41a0ccf8c0d486f8b03f9789a7c348f/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.787315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8175c2b390e44d1ea0a32ff4d78da138, user_id=d41a0ccf8c0d486f8b03f9789a7c348f, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.789970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.800399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1289/2571] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:07 2022] PUT /identity/v3/projects/8175c2b390e44d1ea0a32ff4d78da138/users/d41a0ccf8c0d486f8b03f9789a7c348f/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:07.812031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a46bd-4c7b-443c-98d7-38c4c9b9ae81 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.812551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a46bd-4c7b-443c-98d7-38c4c9b9ae81 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.812645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a46bd-4c7b-443c-98d7-38c4c9b9ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.845586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6d2a46bd-4c7b-443c-98d7-38c4c9b9ae81 None None] MFA Rules not processed for user `d41a0ccf8c0d486f8b03f9789a7c348f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:07.846769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6d2a46bd-4c7b-443c-98d7-38c4c9b9ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:07.857042 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.858932 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:07.925976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1283/2572] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:07.937296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a46bd-4c7b-443c-98d7-38c4c9b9ae81 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:07.938250 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316302-6f2c-4151-b486-75dab2f69302 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:07.938794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6d2a46bd-4c7b-443c-98d7-38c4c9b9ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:07.943594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:07.944303 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:07.944649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:07.945005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] PATH_INFO: `/v3/projects/f9f749d8dd1d4fe2a7f651b86146e58a` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:07.946310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f749d8dd1d4fe2a7f651b86146e58a)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:07.948222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:07.994143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:07.999685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f749d8dd1d4fe2a7f651b86146e58a', 'request_id': 'req-1828a335-dc7a-4572-8671-74751ad287a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:07.999977 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a46bd-4c7b-443c-98d7-38c4c9b9ae81 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.007836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f749d8dd1d4fe2a7f651b86146e58a', 'request_id': 'req-1828a335-dc7a-4572-8671-74751ad287a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:08.014073 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f749d8dd1d4fe2a7f651b86146e58a', 'request_id': 'req-1828a335-dc7a-4572-8671-74751ad287a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:08.025861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] The token cache is being invalidate because project f9f749d8dd1d4fe2a7f651b86146e58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:08.026152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:08.026814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1828a335-dc7a-4572-8671-74751ad287a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:08.028569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1290/2573] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:07 2022] DELETE /identity/v3/projects/f9f749d8dd1d4fe2a7f651b86146e58a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:08.032989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376a810-23e1-463d-888b-6219d4afd781 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.033308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376a810-23e1-463d-888b-6219d4afd781 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.033750 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376a810-23e1-463d-888b-6219d4afd781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.042946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:08.051896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.052669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.053045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.053387 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.055245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:08.055452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a376a810-23e1-463d-888b-6219d4afd781 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:08.056626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a376a810-23e1-463d-888b-6219d4afd781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:08.114986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.116325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.116615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1291/2574] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:08.124836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd92a5-7ccb-49b6-addb-2040ed31e47c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.125127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd92a5-7ccb-49b6-addb-2040ed31e47c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.125420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd92a5-7ccb-49b6-addb-2040ed31e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.127276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1284/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:19:08.145472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a8dd92a5-7ccb-49b6-addb-2040ed31e47c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:08.147245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a8dd92a5-7ccb-49b6-addb-2040ed31e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:08.155396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1292/2576] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:08.159434 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.170057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e2295-30ec-4646-82f2-cfef8294f9a1 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.174769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.175371 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.175654 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.175929 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.176574 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:08.176875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.178546 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.190439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1285/2577] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:08.195090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd92a5-7ccb-49b6-addb-2040ed31e47c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.204418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd92a5-7ccb-49b6-addb-2040ed31e47c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.209712 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16503602-f219-4171-b995-51502682f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.210311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503602-f219-4171-b995-51502682f6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.210591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503602-f219-4171-b995-51502682f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.210864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503602-f219-4171-b995-51502682f6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.211509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16503602-f219-4171-b995-51502682f6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.213446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16503602-f219-4171-b995-51502682f6b9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.243649 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1293/2578] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:08 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:08.247960 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.259207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24079485-4327-4c02-b766-b1f98d6960dd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.300168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ff11-5781-4c86-bed2-74122fc9cd55 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.300573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ff11-5781-4c86-bed2-74122fc9cd55 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.300953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ff11-5781-4c86-bed2-74122fc9cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.323759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2ae9ff11-5781-4c86-bed2-74122fc9cd55 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:08.325211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2ae9ff11-5781-4c86-bed2-74122fc9cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:08.328455 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fe9a-67ea-4f0d-ab9d-aacc47021dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.329744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fe9a-67ea-4f0d-ab9d-aacc47021dff admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.330075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fe9a-67ea-4f0d-ab9d-aacc47021dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.330353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fe9a-67ea-4f0d-ab9d-aacc47021dff admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.331007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8fe9a-67ea-4f0d-ab9d-aacc47021dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.333436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8fe9a-67ea-4f0d-ab9d-aacc47021dff admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.368570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1286/2579] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:08 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:08.369768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fe9a-67ea-4f0d-ab9d-aacc47021dff admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.387569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fe9a-67ea-4f0d-ab9d-aacc47021dff admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.393427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90548-29db-430b-9287-6b9295f9759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.393994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90548-29db-430b-9287-6b9295f9759e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.394349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90548-29db-430b-9287-6b9295f9759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.394538 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90548-29db-430b-9287-6b9295f9759e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.395192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90548-29db-430b-9287-6b9295f9759e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.397638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90548-29db-430b-9287-6b9295f9759e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.414676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1287/2580] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:08.415717 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90548-29db-430b-9287-6b9295f9759e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.427655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90548-29db-430b-9287-6b9295f9759e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.434194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.434810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.435131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.435427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.436109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.436513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1294/2581] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 8 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:08.437906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.450293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1288/2582] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:08.456019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ff11-5781-4c86-bed2-74122fc9cd55 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.456264 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.459216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:08.472026 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ff11-5781-4c86-bed2-74122fc9cd55 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.476148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:08.478987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d010330-cfca-4cf1-bf6a-fd5efe21fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.480164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010330-cfca-4cf1-bf6a-fd5efe21fad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.480586 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010330-cfca-4cf1-bf6a-fd5efe21fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.480965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010330-cfca-4cf1-bf6a-fd5efe21fad5 admin admin] PATH_INFO: `/v3/projects/d9f0177648194c7b9a29034d825d4359/users/7baf61a96e3446e28fbd64c61c382ee6/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.505847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d010330-cfca-4cf1-bf6a-fd5efe21fad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f0177648194c7b9a29034d825d4359, user_id=7baf61a96e3446e28fbd64c61c382ee6, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.509700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d010330-cfca-4cf1-bf6a-fd5efe21fad5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.545822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1295/2583] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:08 2022] PUT /identity/v3/projects/d9f0177648194c7b9a29034d825d4359/users/7baf61a96e3446e28fbd64c61c382ee6/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:08.556597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42f72e-19c1-4fb8-9845-9aeb8fb208d4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.556889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42f72e-19c1-4fb8-9845-9aeb8fb208d4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.557164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42f72e-19c1-4fb8-9845-9aeb8fb208d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.599198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3c42f72e-19c1-4fb8-9845-9aeb8fb208d4 None None] MFA Rules not processed for user `7baf61a96e3446e28fbd64c61c382ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:08.601583 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3c42f72e-19c1-4fb8-9845-9aeb8fb208d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:08.606000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f02b85-8ad0-4653-b865-f8d8004cbc7d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.654361 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:08.676486 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1296/2584] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:08.681538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42f72e-19c1-4fb8-9845-9aeb8fb208d4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.684069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b461554-8648-4e36-83ca-fb8567464343 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.684771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461554-8648-4e36-83ca-fb8567464343 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.685123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461554-8648-4e36-83ca-fb8567464343 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.685507 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461554-8648-4e36-83ca-fb8567464343 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.742955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b461554-8648-4e36-83ca-fb8567464343 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.744549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b461554-8648-4e36-83ca-fb8567464343 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.745265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42f72e-19c1-4fb8-9845-9aeb8fb208d4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.750974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cb7ed-ead0-45a8-b9b3-91cb10f403f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.751654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb7ed-ead0-45a8-b9b3-91cb10f403f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.751929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb7ed-ead0-45a8-b9b3-91cb10f403f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.752201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb7ed-ead0-45a8-b9b3-91cb10f403f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.753079 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cb7ed-ead0-45a8-b9b3-91cb10f403f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.753188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1289/2585] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:19:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:19:08.755894 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cb7ed-ead0-45a8-b9b3-91cb10f403f3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.783615 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1297/2586] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:08 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:08.787823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b461554-8648-4e36-83ca-fb8567464343 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.798266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b461554-8648-4e36-83ca-fb8567464343 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.852771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:08.860270 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937f672-2995-4443-9f0e-b42d5e5149dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.860887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f672-2995-4443-9f0e-b42d5e5149dd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.861168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f672-2995-4443-9f0e-b42d5e5149dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.861602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f672-2995-4443-9f0e-b42d5e5149dd admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.862246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937f672-2995-4443-9f0e-b42d5e5149dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.864186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937f672-2995-4443-9f0e-b42d5e5149dd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.888096 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1290/2587] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:08 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:08.892537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cb7ed-ead0-45a8-b9b3-91cb10f403f3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.903665 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cb7ed-ead0-45a8-b9b3-91cb10f403f3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.908675 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36ec9f-939b-4d73-80d2-094222133a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.909288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36ec9f-939b-4d73-80d2-094222133a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.909641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36ec9f-939b-4d73-80d2-094222133a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.909914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36ec9f-939b-4d73-80d2-094222133a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.910653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36ec9f-939b-4d73-80d2-094222133a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.912810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36ec9f-939b-4d73-80d2-094222133a35 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.933424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1298/2588] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:19:08.937985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937f672-2995-4443-9f0e-b42d5e5149dd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:08.948876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937f672-2995-4443-9f0e-b42d5e5149dd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:08.954294 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267186b8-5bfc-442b-af92-958c129ae3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:08.959352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267186b8-5bfc-442b-af92-958c129ae3af admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:08.959659 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267186b8-5bfc-442b-af92-958c129ae3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:08.959937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267186b8-5bfc-442b-af92-958c129ae3af admin admin] PATH_INFO: `/v3/projects/fc5d310b0f554daabf663d1788bd7e3a/users/15bbab0f946043a5bad5a112dd7fc67b/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:08.981348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267186b8-5bfc-442b-af92-958c129ae3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5d310b0f554daabf663d1788bd7e3a, user_id=15bbab0f946043a5bad5a112dd7fc67b, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:08.984459 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267186b8-5bfc-442b-af92-958c129ae3af admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:08.998866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1291/2589] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:08 2022] PUT /identity/v3/projects/fc5d310b0f554daabf663d1788bd7e3a/users/15bbab0f946043a5bad5a112dd7fc67b/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:09.003707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36ec9f-939b-4d73-80d2-094222133a35 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:09.014487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36ec9f-939b-4d73-80d2-094222133a35 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:09.075500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536bddc-6cac-4e53-bc6b-3c3693a22d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:09.076116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bddc-6cac-4e53-bc6b-3c3693a22d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:09.076392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bddc-6cac-4e53-bc6b-3c3693a22d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:09.076663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bddc-6cac-4e53-bc6b-3c3693a22d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:09.077299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536bddc-6cac-4e53-bc6b-3c3693a22d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:09.078926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536bddc-6cac-4e53-bc6b-3c3693a22d93 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:09.089053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1299/2590] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:09.093166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267186b8-5bfc-442b-af92-958c129ae3af admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:09.104130 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267186b8-5bfc-442b-af92-958c129ae3af admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:09.108909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:09.109695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:09.110040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:09.110381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] PATH_INFO: `/v3/projects/fc5d310b0f554daabf663d1788bd7e3a/users/15bbab0f946043a5bad5a112dd7fc67b/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:09.112409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5d310b0f554daabf663d1788bd7e3a, user_id=15bbab0f946043a5bad5a112dd7fc67b, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:09.115724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:09.126446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1292/2591] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:09 2022] PUT /identity/v3/projects/fc5d310b0f554daabf663d1788bd7e3a/users/15bbab0f946043a5bad5a112dd7fc67b/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:09.138225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c80f-d020-4208-9f33-63135538aadb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:09.138764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c80f-d020-4208-9f33-63135538aadb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:09.138764 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c80f-d020-4208-9f33-63135538aadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:09.168857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6ae2c80f-d020-4208-9f33-63135538aadb None None] MFA Rules not processed for user `15bbab0f946043a5bad5a112dd7fc67b`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:09.170035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6ae2c80f-d020-4208-9f33-63135538aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:09.215697 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:09.241123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1300/2592] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:09.256973 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:09.259002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:09.319503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf5435-8a29-4989-bd53-b0b0978d02f9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:09.323161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82f48c-91dd-4f66-b2eb-ca5a7fdf7369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:09.323769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f48c-91dd-4f66-b2eb-ca5a7fdf7369 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:09.324048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f48c-91dd-4f66-b2eb-ca5a7fdf7369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:09.324349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f48c-91dd-4f66-b2eb-ca5a7fdf7369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:09.334161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82f48c-91dd-4f66-b2eb-ca5a7fdf7369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:09.335589 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82f48c-91dd-4f66-b2eb-ca5a7fdf7369 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:09.345439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1293/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:09 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:09.491164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2c80f-d020-4208-9f33-63135538aadb None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:09.553504 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2c80f-d020-4208-9f33-63135538aadb None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:09.558016 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:09.558641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:09.558922 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:09.559199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] PATH_INFO: `/v3/users/7baf61a96e3446e28fbd64c61c382ee6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:09.560308 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7baf61a96e3446e28fbd64c61c382ee6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:09.562252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:09.614438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7baf61a96e3446e28fbd64c61c382ee6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:09.636682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7baf61a96e3446e28fbd64c61c382ee6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:09.647251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7baf61a96e3446e28fbd64c61c382ee6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:09.648012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7baf61a96e3446e28fbd64c61c382ee6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:09.658445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7baf61a96e3446e28fbd64c61c382ee6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:09.666971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1301/2594] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:09 2022] DELETE /identity/v3/users/7baf61a96e3446e28fbd64c61c382ee6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:09.671292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a945-a8f0-4588-b186-ee519bed6275 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:09.671584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a945-a8f0-4588-b186-ee519bed6275 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:09.671862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a945-a8f0-4588-b186-ee519bed6275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:09.699039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7100a945-a8f0-4588-b186-ee519bed6275 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:09.699039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7100a945-a8f0-4588-b186-ee519bed6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:09.764085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1294/2595] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:09.773720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:09.775184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:09.837949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b7969-10a5-433b-be9f-cd895bc153d2 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:09.841822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113446b-5662-434c-9aff-248415d7d600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:09.842454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113446b-5662-434c-9aff-248415d7d600 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:09.842738 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113446b-5662-434c-9aff-248415d7d600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:09.843009 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113446b-5662-434c-9aff-248415d7d600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:09.853862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113446b-5662-434c-9aff-248415d7d600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:09.855430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113446b-5662-434c-9aff-248415d7d600 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:09.866717 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1302/2596] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:10.138846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100a945-a8f0-4588-b186-ee519bed6275 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:10.140336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7100a945-a8f0-4588-b186-ee519bed6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:10.154471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100a945-a8f0-4588-b186-ee519bed6275 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:10.159814 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:10.160639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:10.160932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:10.161209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] PATH_INFO: `/v3/projects/d9f0177648194c7b9a29034d825d4359` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:10.162951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f0177648194c7b9a29034d825d4359)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:10.164868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:10.209252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:10.212113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f0177648194c7b9a29034d825d4359', 'request_id': 'req-d2499246-dbdb-4814-a1f5-996027883558'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.218795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f0177648194c7b9a29034d825d4359', 'request_id': 'req-d2499246-dbdb-4814-a1f5-996027883558'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.225634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f0177648194c7b9a29034d825d4359', 'request_id': 'req-d2499246-dbdb-4814-a1f5-996027883558'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.238189 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] The token cache is being invalidate because project d9f0177648194c7b9a29034d825d4359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:10.238500 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.239131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.240605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1295/2597] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:10 2022] DELETE /identity/v3/projects/d9f0177648194c7b9a29034d825d4359 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:10.244680 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113446b-5662-434c-9aff-248415d7d600 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:10.250740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:10.255305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113446b-5662-434c-9aff-248415d7d600 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:10.315923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:10.316611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:10.316895 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:10.317171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] PATH_INFO: `/v3/users/15bbab0f946043a5bad5a112dd7fc67b` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:10.318890 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15bbab0f946043a5bad5a112dd7fc67b)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:10.320827 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:10.365917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15bbab0f946043a5bad5a112dd7fc67b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.378467 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15bbab0f946043a5bad5a112dd7fc67b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.385276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15bbab0f946043a5bad5a112dd7fc67b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.385940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15bbab0f946043a5bad5a112dd7fc67b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.392942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-af8cc7e2-c22d-4799-86de-239f020b1124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15bbab0f946043a5bad5a112dd7fc67b'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.398888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1303/2598] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:10 2022] DELETE /identity/v3/users/15bbab0f946043a5bad5a112dd7fc67b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:10.663794 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:10.665273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:10.679424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2499246-dbdb-4814-a1f5-996027883558 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:10.736638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:10.737269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:10.737592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:10.737868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] PATH_INFO: `/v3/projects/fc5d310b0f554daabf663d1788bd7e3a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:10.738975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5d310b0f554daabf663d1788bd7e3a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:10.741430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:10.787722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5d310b0f554daabf663d1788bd7e3a', 'request_id': 'req-8021b909-cd91-4144-90f7-23aa2c9e4a6b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.793187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5d310b0f554daabf663d1788bd7e3a', 'request_id': 'req-8021b909-cd91-4144-90f7-23aa2c9e4a6b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.799200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5d310b0f554daabf663d1788bd7e3a', 'request_id': 'req-8021b909-cd91-4144-90f7-23aa2c9e4a6b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.812315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] The token cache is being invalidate because project fc5d310b0f554daabf663d1788bd7e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:10.812606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.813424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8021b909-cd91-4144-90f7-23aa2c9e4a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:10.814951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1296/2599] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:10 2022] DELETE /identity/v3/projects/fc5d310b0f554daabf663d1788bd7e3a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:10.820390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4d30-668e-4ee9-893d-21151b6f216c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:10.820674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4d30-668e-4ee9-893d-21151b6f216c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:10.820943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4d30-668e-4ee9-893d-21151b6f216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:10.840513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4adb4d30-668e-4ee9-893d-21151b6f216c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:10.841758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4adb4d30-668e-4ee9-893d-21151b6f216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:10.902695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1304/2600] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:10.910455 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc31c74-f661-40f0-8bd8-0bebf59be4ae None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:10.910747 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc31c74-f661-40f0-8bd8-0bebf59be4ae None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:10.911025 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc31c74-f661-40f0-8bd8-0bebf59be4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:10.933223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0cc31c74-f661-40f0-8bd8-0bebf59be4ae None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:10.934529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0cc31c74-f661-40f0-8bd8-0bebf59be4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:10.943494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1297/2601] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:10.947760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4d30-668e-4ee9-893d-21151b6f216c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:10.957707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4d30-668e-4ee9-893d-21151b6f216c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:10.962935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:10.963800 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:10.964107 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:10.964495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:10.965293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:10.965728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:10.967701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:10.979708 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1305/2602] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:10.983932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc31c74-f661-40f0-8bd8-0bebf59be4ae None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:10.993626 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc31c74-f661-40f0-8bd8-0bebf59be4ae None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:10.998334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277ef2d-d1a0-47f7-9083-6bf51cd9e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:10.998935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277ef2d-d1a0-47f7-9083-6bf51cd9e2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:10.999217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277ef2d-d1a0-47f7-9083-6bf51cd9e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:10.999490 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277ef2d-d1a0-47f7-9083-6bf51cd9e2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.000157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277ef2d-d1a0-47f7-9083-6bf51cd9e2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.002235 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277ef2d-d1a0-47f7-9083-6bf51cd9e2a7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.030722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1298/2603] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:10 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:11.034563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.045347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720bc0-ccfd-48a0-b297-a4d05123dda5 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.056788 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:11.109036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a1424-2a03-4730-8fc4-ec8371cde665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.109682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a1424-2a03-4730-8fc4-ec8371cde665 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.109960 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a1424-2a03-4730-8fc4-ec8371cde665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.110230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a1424-2a03-4730-8fc4-ec8371cde665 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.110883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a1424-2a03-4730-8fc4-ec8371cde665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.112937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a1424-2a03-4730-8fc4-ec8371cde665 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.141184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1306/2604] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:11 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:11.143163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277ef2d-d1a0-47f7-9083-6bf51cd9e2a7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.154396 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277ef2d-d1a0-47f7-9083-6bf51cd9e2a7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.158980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726af9e9-874a-44bc-8876-c99c072dacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.159578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af9e9-874a-44bc-8876-c99c072dacdf admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.159851 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af9e9-874a-44bc-8876-c99c072dacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.160120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af9e9-874a-44bc-8876-c99c072dacdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.160755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726af9e9-874a-44bc-8876-c99c072dacdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.162882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726af9e9-874a-44bc-8876-c99c072dacdf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.173126 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1299/2605] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:11.177900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a1424-2a03-4730-8fc4-ec8371cde665 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.188146 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a1424-2a03-4730-8fc4-ec8371cde665 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.193227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d858987-5277-478b-bffc-9c89336c1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.193934 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858987-5277-478b-bffc-9c89336c1fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.194245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858987-5277-478b-bffc-9c89336c1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.194521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d858987-5277-478b-bffc-9c89336c1fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.195207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d858987-5277-478b-bffc-9c89336c1fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.196825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d858987-5277-478b-bffc-9c89336c1fe8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.210622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1307/2606] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:11.211744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726af9e9-874a-44bc-8876-c99c072dacdf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.222541 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726af9e9-874a-44bc-8876-c99c072dacdf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.228617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfa5b2-c556-4d5d-b355-2964f2160981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.229530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa5b2-c556-4d5d-b355-2964f2160981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.229636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa5b2-c556-4d5d-b355-2964f2160981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.229938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfa5b2-c556-4d5d-b355-2964f2160981 admin admin] PATH_INFO: `/v3/projects/9e9f8b6dfdbf4338adbdf3631724f10d/users/3bd940946b4747e3a512fa1e6f72fd03/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.245535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfa5b2-c556-4d5d-b355-2964f2160981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9f8b6dfdbf4338adbdf3631724f10d, user_id=3bd940946b4747e3a512fa1e6f72fd03, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.248182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfa5b2-c556-4d5d-b355-2964f2160981 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.258282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:11.273563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1300/2607] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:11 2022] PUT /identity/v3/projects/9e9f8b6dfdbf4338adbdf3631724f10d/users/3bd940946b4747e3a512fa1e6f72fd03/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:11.275252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfabd0a-196c-4f87-941a-6ed0d2447875 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.275701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfabd0a-196c-4f87-941a-6ed0d2447875 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.275843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfabd0a-196c-4f87-941a-6ed0d2447875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.305830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-bdfabd0a-196c-4f87-941a-6ed0d2447875 None None] MFA Rules not processed for user `3bd940946b4747e3a512fa1e6f72fd03`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:11.306979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-bdfabd0a-196c-4f87-941a-6ed0d2447875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:11.390562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1308/2608] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:11.394354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfa5b2-c556-4d5d-b355-2964f2160981 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.457705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfa5b2-c556-4d5d-b355-2964f2160981 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.462998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f151f-b6b3-4a8f-8c21-729f161e376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.463595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f151f-b6b3-4a8f-8c21-729f161e376d admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.463875 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f151f-b6b3-4a8f-8c21-729f161e376d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.464146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f151f-b6b3-4a8f-8c21-729f161e376d admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.464809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f151f-b6b3-4a8f-8c21-729f161e376d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.466771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f151f-b6b3-4a8f-8c21-729f161e376d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.492556 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1301/2609] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:11 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:11.496611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfabd0a-196c-4f87-941a-6ed0d2447875 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.507641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfabd0a-196c-4f87-941a-6ed0d2447875 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.565166 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d73456-8bf9-4131-aa93-e316705048a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.565734 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73456-8bf9-4131-aa93-e316705048a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.566022 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73456-8bf9-4131-aa93-e316705048a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.566300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d73456-8bf9-4131-aa93-e316705048a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.566948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d73456-8bf9-4131-aa93-e316705048a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.569058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d73456-8bf9-4131-aa93-e316705048a8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.591355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1309/2610] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:11 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:11.595337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f151f-b6b3-4a8f-8c21-729f161e376d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.606671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f151f-b6b3-4a8f-8c21-729f161e376d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.611295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e1f2-ff48-4b66-a1c0-b5ff07c5db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.611897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e1f2-ff48-4b66-a1c0-b5ff07c5db67 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.612177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e1f2-ff48-4b66-a1c0-b5ff07c5db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.612450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e1f2-ff48-4b66-a1c0-b5ff07c5db67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.613087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e1f2-ff48-4b66-a1c0-b5ff07c5db67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.614768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e1f2-ff48-4b66-a1c0-b5ff07c5db67 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.625292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1302/2611] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:11.630001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d73456-8bf9-4131-aa93-e316705048a8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.640164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d73456-8bf9-4131-aa93-e316705048a8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.644980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d25884-044d-4da2-a164-6fddb8494810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.646189 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25884-044d-4da2-a164-6fddb8494810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.646492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25884-044d-4da2-a164-6fddb8494810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.646756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25884-044d-4da2-a164-6fddb8494810 admin admin] PATH_INFO: `/v3/projects/b8d094d7de6b4404ad7e3e678d7efb00/users/42d9f827e8c4491b9fcd719ecfd86ff5/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.649934 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:11.662965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d25884-044d-4da2-a164-6fddb8494810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d094d7de6b4404ad7e3e678d7efb00, user_id=42d9f827e8c4491b9fcd719ecfd86ff5, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.665751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d25884-044d-4da2-a164-6fddb8494810 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.678289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1310/2612] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:11 2022] PUT /identity/v3/projects/b8d094d7de6b4404ad7e3e678d7efb00/users/42d9f827e8c4491b9fcd719ecfd86ff5/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:11.682348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e1f2-ff48-4b66-a1c0-b5ff07c5db67 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.692328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e1f2-ff48-4b66-a1c0-b5ff07c5db67 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.747859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376f1e9-7fbd-4447-b3bb-9f7b81350a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.748458 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376f1e9-7fbd-4447-b3bb-9f7b81350a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.748739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376f1e9-7fbd-4447-b3bb-9f7b81350a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.749016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376f1e9-7fbd-4447-b3bb-9f7b81350a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.749690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376f1e9-7fbd-4447-b3bb-9f7b81350a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.751319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376f1e9-7fbd-4447-b3bb-9f7b81350a4c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.761203 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1303/2613] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:11.765280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d25884-044d-4da2-a164-6fddb8494810 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.775938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d25884-044d-4da2-a164-6fddb8494810 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.780537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.781206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.781517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.781792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] PATH_INFO: `/v3/projects/b8d094d7de6b4404ad7e3e678d7efb00/users/42d9f827e8c4491b9fcd719ecfd86ff5/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.783709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d094d7de6b4404ad7e3e678d7efb00, user_id=42d9f827e8c4491b9fcd719ecfd86ff5, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:11.786492 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:11.796414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1311/2614] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:11 2022] PUT /identity/v3/projects/b8d094d7de6b4404ad7e3e678d7efb00/users/42d9f827e8c4491b9fcd719ecfd86ff5/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:11.808525 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8cc8-b460-4a9e-bfe9-6b9699fb5a5e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.808811 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8cc8-b460-4a9e-bfe9-6b9699fb5a5e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.809088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8cc8-b460-4a9e-bfe9-6b9699fb5a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:11.838220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-892e8cc8-b460-4a9e-bfe9-6b9699fb5a5e None None] MFA Rules not processed for user `42d9f827e8c4491b9fcd719ecfd86ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:11.839583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-892e8cc8-b460-4a9e-bfe9-6b9699fb5a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:11.903147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:11.918773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1304/2615] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:11.930611 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:11.932355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:11.992812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a6d6f-4467-46e4-86a1-d6032660288c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:11.996422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dedc1-dae7-44d1-a873-0bd1324e8c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:11.997015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dedc1-dae7-44d1-a873-0bd1324e8c53 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:11.997292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dedc1-dae7-44d1-a873-0bd1324e8c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:11.997589 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dedc1-dae7-44d1-a873-0bd1324e8c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:12.007184 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dedc1-dae7-44d1-a873-0bd1324e8c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:12.008602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dedc1-dae7-44d1-a873-0bd1324e8c53 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:12.017794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1312/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:12.093426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e8cc8-b460-4a9e-bfe9-6b9699fb5a5e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:12.102984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e8cc8-b460-4a9e-bfe9-6b9699fb5a5e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:12.106564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a85d82-4542-4756-b6da-d2302f240214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:12.107158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a85d82-4542-4756-b6da-d2302f240214 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:12.107431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a85d82-4542-4756-b6da-d2302f240214 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:12.107697 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a85d82-4542-4756-b6da-d2302f240214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:12.163205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a85d82-4542-4756-b6da-d2302f240214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:12.164622 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a85d82-4542-4756-b6da-d2302f240214 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:12.173623 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1305/2617] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:12.496259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dedc1-dae7-44d1-a873-0bd1324e8c53 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:12.505745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dedc1-dae7-44d1-a873-0bd1324e8c53 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:12.509547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507bd9d-9c96-4284-bfc8-4817baf157ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:12.510158 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507bd9d-9c96-4284-bfc8-4817baf157ab service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:12.510523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507bd9d-9c96-4284-bfc8-4817baf157ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:12.510692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507bd9d-9c96-4284-bfc8-4817baf157ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:12.512575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3507bd9d-9c96-4284-bfc8-4817baf157ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:12.575998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507bd9d-9c96-4284-bfc8-4817baf157ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:12.577445 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507bd9d-9c96-4284-bfc8-4817baf157ab service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:12.586877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1313/2618] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:14.888478 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a85d82-4542-4756-b6da-d2302f240214 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:14.950800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a85d82-4542-4756-b6da-d2302f240214 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:14.955268 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:14.955891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:14.956172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:14.956453 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] PATH_INFO: `/v3/users/3bd940946b4747e3a512fa1e6f72fd03` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:14.957591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd940946b4747e3a512fa1e6f72fd03)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:14.960118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:15.005494 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd940946b4747e3a512fa1e6f72fd03'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.012787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd940946b4747e3a512fa1e6f72fd03'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.025397 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd940946b4747e3a512fa1e6f72fd03'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.025991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd940946b4747e3a512fa1e6f72fd03'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.032827 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd940946b4747e3a512fa1e6f72fd03'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.038780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1306/2619] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:14 2022] DELETE /identity/v3/users/3bd940946b4747e3a512fa1e6f72fd03 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:15.043257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d1671-3f72-4571-8319-5114a83f6b62 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:15.043733 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d1671-3f72-4571-8319-5114a83f6b62 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:15.043841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d1671-3f72-4571-8319-5114a83f6b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:15.062375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f80d1671-3f72-4571-8319-5114a83f6b62 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:15.063576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f80d1671-3f72-4571-8319-5114a83f6b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:15.122453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1314/2620] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:15.132755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:15.134142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:15.148627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:15.197496 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb215f-4238-4472-9e2b-ad16ebf1aecf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:15.201196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb5bc-552e-4a38-91f4-ab9b7ceec4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:15.201837 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb5bc-552e-4a38-91f4-ab9b7ceec4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:15.202114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb5bc-552e-4a38-91f4-ab9b7ceec4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:15.202383 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb5bc-552e-4a38-91f4-ab9b7ceec4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:15.212620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cb5bc-552e-4a38-91f4-ab9b7ceec4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:15.214112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cb5bc-552e-4a38-91f4-ab9b7ceec4e6 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:15.223503 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1307/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:15.491613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d1671-3f72-4571-8319-5114a83f6b62 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:15.493132 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f80d1671-3f72-4571-8319-5114a83f6b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:15.508085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d1671-3f72-4571-8319-5114a83f6b62 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:15.514457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:15.515180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:15.515528 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:15.515869 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] PATH_INFO: `/v3/projects/9e9f8b6dfdbf4338adbdf3631724f10d` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:15.517080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9f8b6dfdbf4338adbdf3631724f10d)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:15.519864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:15.522889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:15.569182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9f8b6dfdbf4338adbdf3631724f10d', 'request_id': 'req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.577117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9f8b6dfdbf4338adbdf3631724f10d', 'request_id': 'req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.582779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9f8b6dfdbf4338adbdf3631724f10d', 'request_id': 'req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.594177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] The token cache is being invalidate because project 9e9f8b6dfdbf4338adbdf3631724f10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:15.594465 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.595089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.596547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1315/2622] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:15 2022] DELETE /identity/v3/projects/9e9f8b6dfdbf4338adbdf3631724f10d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:15.601135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb5bc-552e-4a38-91f4-ab9b7ceec4e6 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:15.610890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb5bc-552e-4a38-91f4-ab9b7ceec4e6 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:15.671800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:15.672427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:15.672703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:15.673675 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] PATH_INFO: `/v3/users/42d9f827e8c4491b9fcd719ecfd86ff5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:15.674796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d9f827e8c4491b9fcd719ecfd86ff5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:15.676726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:15.720312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d9f827e8c4491b9fcd719ecfd86ff5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.728080 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d9f827e8c4491b9fcd719ecfd86ff5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.740722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d9f827e8c4491b9fcd719ecfd86ff5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.741357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d9f827e8c4491b9fcd719ecfd86ff5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.748527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c99cce9a-28a4-473d-a25c-60f4b365e817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d9f827e8c4491b9fcd719ecfd86ff5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:15.754607 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1308/2623] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:15 2022] DELETE /identity/v3/users/42d9f827e8c4491b9fcd719ecfd86ff5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:16.019811 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.021873 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:16.039052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f4cb-d0f6-449f-ba4e-d04aaec6e611 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.095271 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.095924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.096085 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.096352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] PATH_INFO: `/v3/projects/b8d094d7de6b4404ad7e3e678d7efb00` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.097485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d094d7de6b4404ad7e3e678d7efb00)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.100012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.144801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d094d7de6b4404ad7e3e678d7efb00', 'request_id': 'req-3ed50cec-9e4d-4477-9382-fc1f70e65c27'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:16.152464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d094d7de6b4404ad7e3e678d7efb00', 'request_id': 'req-3ed50cec-9e4d-4477-9382-fc1f70e65c27'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:16.157914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d094d7de6b4404ad7e3e678d7efb00', 'request_id': 'req-3ed50cec-9e4d-4477-9382-fc1f70e65c27'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:16.169018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] The token cache is being invalidate because project b8d094d7de6b4404ad7e3e678d7efb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:16.169310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:16.169959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-3ed50cec-9e4d-4477-9382-fc1f70e65c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:16.171393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1316/2624] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:16 2022] DELETE /identity/v3/projects/b8d094d7de6b4404ad7e3e678d7efb00 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:16.176305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b4d26-f2c5-4f6e-84ec-a6335910b083 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.176770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b4d26-f2c5-4f6e-84ec-a6335910b083 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.176864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b4d26-f2c5-4f6e-84ec-a6335910b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.195947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-635b4d26-f2c5-4f6e-84ec-a6335910b083 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:16.197129 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-635b4d26-f2c5-4f6e-84ec-a6335910b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:16.226994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:16.256771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1309/2625] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:16.264731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b216058-0d5d-4679-a55d-2bf118c2b93e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.265025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b216058-0d5d-4679-a55d-2bf118c2b93e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.265330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b216058-0d5d-4679-a55d-2bf118c2b93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.285345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9b216058-0d5d-4679-a55d-2bf118c2b93e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:16.287200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9b216058-0d5d-4679-a55d-2bf118c2b93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:16.295068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1317/2626] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:16.299164 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b4d26-f2c5-4f6e-84ec-a6335910b083 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.309174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b4d26-f2c5-4f6e-84ec-a6335910b083 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.313971 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.314580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.314859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.315132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.315779 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:16.316081 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.318215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.330815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1310/2627] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:16.335563 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b216058-0d5d-4679-a55d-2bf118c2b93e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.344862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b216058-0d5d-4679-a55d-2bf118c2b93e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.349671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab928-c395-42d1-a2d2-2d7ef59deb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.350883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab928-c395-42d1-a2d2-2d7ef59deb29 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.351174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab928-c395-42d1-a2d2-2d7ef59deb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.351447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab928-c395-42d1-a2d2-2d7ef59deb29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.352090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab928-c395-42d1-a2d2-2d7ef59deb29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.354001 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab928-c395-42d1-a2d2-2d7ef59deb29 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.369975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:16.388422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1318/2628] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:16 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:16.389734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.402486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f771c97-c042-4f92-913c-90d172bb3f3f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.461491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f861c-7ac6-4c59-875a-5566cefcb28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.462123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f861c-7ac6-4c59-875a-5566cefcb28e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.462406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f861c-7ac6-4c59-875a-5566cefcb28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.462681 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f861c-7ac6-4c59-875a-5566cefcb28e admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.463305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f861c-7ac6-4c59-875a-5566cefcb28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.465308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f861c-7ac6-4c59-875a-5566cefcb28e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.489451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1311/2629] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:16 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:16.490742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab928-c395-42d1-a2d2-2d7ef59deb29 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.500999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab928-c395-42d1-a2d2-2d7ef59deb29 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.506766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d0224-a2aa-466f-86bd-3d010772977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.507414 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0224-a2aa-466f-86bd-3d010772977b admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.507688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0224-a2aa-466f-86bd-3d010772977b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.507967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0224-a2aa-466f-86bd-3d010772977b admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.508608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d0224-a2aa-466f-86bd-3d010772977b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.510245 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d0224-a2aa-466f-86bd-3d010772977b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.521605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1319/2630] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:16.525787 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f861c-7ac6-4c59-875a-5566cefcb28e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.535612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f861c-7ac6-4c59-875a-5566cefcb28e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.540535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334efec9-a306-4b81-94e0-6d11c7b7a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.541133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efec9-a306-4b81-94e0-6d11c7b7a5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.541443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efec9-a306-4b81-94e0-6d11c7b7a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.541777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efec9-a306-4b81-94e0-6d11c7b7a5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.542535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334efec9-a306-4b81-94e0-6d11c7b7a5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.544271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334efec9-a306-4b81-94e0-6d11c7b7a5f8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.555785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1312/2631] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:16.560306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d0224-a2aa-466f-86bd-3d010772977b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.571306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d0224-a2aa-466f-86bd-3d010772977b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.575950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4497-5d42-486b-a55f-7c6b1ec779fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.576594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4497-5d42-486b-a55f-7c6b1ec779fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.576875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4497-5d42-486b-a55f-7c6b1ec779fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.577151 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb4497-5d42-486b-a55f-7c6b1ec779fd admin admin] PATH_INFO: `/v3/projects/1d3619b5e783401fb1cc178ea2aa8308/users/06a805fadf1b42dea889ae82c6eed7e7/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.592282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb4497-5d42-486b-a55f-7c6b1ec779fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3619b5e783401fb1cc178ea2aa8308, user_id=06a805fadf1b42dea889ae82c6eed7e7, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.595054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb4497-5d42-486b-a55f-7c6b1ec779fd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.607735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1320/2632] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:16 2022] PUT /identity/v3/projects/1d3619b5e783401fb1cc178ea2aa8308/users/06a805fadf1b42dea889ae82c6eed7e7/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:16.619568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493a93e-2a16-4488-8122-f520dfdca23b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.619878 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493a93e-2a16-4488-8122-f520dfdca23b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.620149 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493a93e-2a16-4488-8122-f520dfdca23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.649766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3493a93e-2a16-4488-8122-f520dfdca23b None None] MFA Rules not processed for user `06a805fadf1b42dea889ae82c6eed7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:16.650982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3493a93e-2a16-4488-8122-f520dfdca23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:16.718009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1313/2633] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:16.719134 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4497-5d42-486b-a55f-7c6b1ec779fd admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.781275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb4497-5d42-486b-a55f-7c6b1ec779fd admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.785879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e116-d5eb-4c92-a705-194c01634955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.786476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e116-d5eb-4c92-a705-194c01634955 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.786752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e116-d5eb-4c92-a705-194c01634955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.787020 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e116-d5eb-4c92-a705-194c01634955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.787633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4e116-d5eb-4c92-a705-194c01634955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.789537 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4e116-d5eb-4c92-a705-194c01634955 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.815704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1321/2634] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:16 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:16.820696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493a93e-2a16-4488-8122-f520dfdca23b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.831192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493a93e-2a16-4488-8122-f520dfdca23b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.859188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:16.888297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afa62f-673e-4c71-9d36-7970e5405254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.888931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa62f-673e-4c71-9d36-7970e5405254 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.889212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa62f-673e-4c71-9d36-7970e5405254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.889605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa62f-673e-4c71-9d36-7970e5405254 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.890276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afa62f-673e-4c71-9d36-7970e5405254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.892227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afa62f-673e-4c71-9d36-7970e5405254 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.912644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1314/2635] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:16 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:16.916582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e116-d5eb-4c92-a705-194c01634955 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.927323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e116-d5eb-4c92-a705-194c01634955 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.931938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573d2bb-5728-4e86-9ac5-faf1d876acc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.932531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573d2bb-5728-4e86-9ac5-faf1d876acc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.932813 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573d2bb-5728-4e86-9ac5-faf1d876acc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.933086 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573d2bb-5728-4e86-9ac5-faf1d876acc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.933757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573d2bb-5728-4e86-9ac5-faf1d876acc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.935339 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573d2bb-5728-4e86-9ac5-faf1d876acc6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.945961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1322/2636] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:16.950070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afa62f-673e-4c71-9d36-7970e5405254 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:16.960460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afa62f-673e-4c71-9d36-7970e5405254 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:16.965868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4005c-848e-4818-95fb-d2fad33e82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:16.966484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4005c-848e-4818-95fb-d2fad33e82e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:16.966886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4005c-848e-4818-95fb-d2fad33e82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:16.967064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4005c-848e-4818-95fb-d2fad33e82e0 admin admin] PATH_INFO: `/v3/projects/6d727b81a2b84c0ea6bea8e3e6d87910/users/f7e7827fc34d4570ba7c73d1bf9947db/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:16.982692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4005c-848e-4818-95fb-d2fad33e82e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d727b81a2b84c0ea6bea8e3e6d87910, user_id=f7e7827fc34d4570ba7c73d1bf9947db, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:16.985338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4005c-848e-4818-95fb-d2fad33e82e0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:16.998246 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1315/2637] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:16 2022] PUT /identity/v3/projects/6d727b81a2b84c0ea6bea8e3e6d87910/users/f7e7827fc34d4570ba7c73d1bf9947db/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:17.002292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573d2bb-5728-4e86-9ac5-faf1d876acc6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:17.012434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573d2bb-5728-4e86-9ac5-faf1d876acc6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:17.068256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536960b3-4eec-435c-b39c-caae1a911359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:17.068856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536960b3-4eec-435c-b39c-caae1a911359 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:17.069133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536960b3-4eec-435c-b39c-caae1a911359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:17.069420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536960b3-4eec-435c-b39c-caae1a911359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:17.070058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536960b3-4eec-435c-b39c-caae1a911359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:17.071631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536960b3-4eec-435c-b39c-caae1a911359 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:17.081000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1323/2638] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:17.085031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4005c-848e-4818-95fb-d2fad33e82e0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:17.095336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4005c-848e-4818-95fb-d2fad33e82e0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:17.100455 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:17.101092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:17.101369 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:17.101670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] PATH_INFO: `/v3/projects/6d727b81a2b84c0ea6bea8e3e6d87910/users/f7e7827fc34d4570ba7c73d1bf9947db/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:17.103840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d727b81a2b84c0ea6bea8e3e6d87910, user_id=f7e7827fc34d4570ba7c73d1bf9947db, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:17.106470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:17.116599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1316/2639] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:17 2022] PUT /identity/v3/projects/6d727b81a2b84c0ea6bea8e3e6d87910/users/f7e7827fc34d4570ba7c73d1bf9947db/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:17.126243 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4b72-7ae7-41b3-a9b0-8ca369bfce68 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:17.126707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4b72-7ae7-41b3-a9b0-8ca369bfce68 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:17.126804 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a4b72-7ae7-41b3-a9b0-8ca369bfce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:17.155578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e29a4b72-7ae7-41b3-a9b0-8ca369bfce68 None None] MFA Rules not processed for user `f7e7827fc34d4570ba7c73d1bf9947db`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:17.156778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e29a4b72-7ae7-41b3-a9b0-8ca369bfce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:17.172999 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:17.225356 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1324/2640] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:17.236282 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:17.237988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:17.296695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f193-aef0-4a44-b57f-9f588ab76295 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:17.300326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4489b-8d24-4bf7-a443-347cc49de7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:17.300934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4489b-8d24-4bf7-a443-347cc49de7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:17.301214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4489b-8d24-4bf7-a443-347cc49de7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:17.301520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4489b-8d24-4bf7-a443-347cc49de7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:17.355386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4489b-8d24-4bf7-a443-347cc49de7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:17.356834 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4489b-8d24-4bf7-a443-347cc49de7f3 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:17.365514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1317/2641] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:17.460662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a4b72-7ae7-41b3-a9b0-8ca369bfce68 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:17.462191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e29a4b72-7ae7-41b3-a9b0-8ca369bfce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:17.541010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a4b72-7ae7-41b3-a9b0-8ca369bfce68 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:17.546214 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:17.547031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:17.547418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:17.547814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] PATH_INFO: `/v3/users/67f4dc8e0cd8461d9b8eb5fe1ad04998` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:17.548943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f4dc8e0cd8461d9b8eb5fe1ad04998)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:17.550898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:17.603913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f4dc8e0cd8461d9b8eb5fe1ad04998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:17.619634 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f4dc8e0cd8461d9b8eb5fe1ad04998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:17.628201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f4dc8e0cd8461d9b8eb5fe1ad04998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:17.628833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f4dc8e0cd8461d9b8eb5fe1ad04998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:17.637553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f4dc8e0cd8461d9b8eb5fe1ad04998'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:17.643839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1325/2642] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:17 2022] DELETE /identity/v3/users/67f4dc8e0cd8461d9b8eb5fe1ad04998 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:17.649524 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3cc0-89c1-4d8b-a329-a6b973f04b75 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:17.649751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3cc0-89c1-4d8b-a329-a6b973f04b75 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:17.650053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3cc0-89c1-4d8b-a329-a6b973f04b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:17.674628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-97bf3cc0-89c1-4d8b-a329-a6b973f04b75 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:17.675868 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-97bf3cc0-89c1-4d8b-a329-a6b973f04b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:17.710637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:17.739166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1318/2643] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:17.749544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:17.750942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:17.786769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:17.810652 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf15b-07e8-4ea3-8a99-5f952e88fd09 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:17.814340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf461bc-20b9-4401-ac8b-3d2dc78d6146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:17.814943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf461bc-20b9-4401-ac8b-3d2dc78d6146 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:17.815227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf461bc-20b9-4401-ac8b-3d2dc78d6146 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:17.815501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf461bc-20b9-4401-ac8b-3d2dc78d6146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:17.825156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf461bc-20b9-4401-ac8b-3d2dc78d6146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:17.826619 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf461bc-20b9-4401-ac8b-3d2dc78d6146 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:17.835976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1326/2644] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:18.105275 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf3cc0-89c1-4d8b-a329-a6b973f04b75 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:18.106855 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-97bf3cc0-89c1-4d8b-a329-a6b973f04b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:18.120250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf3cc0-89c1-4d8b-a329-a6b973f04b75 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:18.124952 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:18.125668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:18.125955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:18.126234 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] PATH_INFO: `/v3/projects/ccc22ba6dc244a1aa7b8639555e5a1d1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:18.127746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc22ba6dc244a1aa7b8639555e5a1d1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:18.129715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:18.175359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc22ba6dc244a1aa7b8639555e5a1d1', 'request_id': 'req-89de96b1-98df-4c1b-8cb3-9400407b6efa'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.181661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc22ba6dc244a1aa7b8639555e5a1d1', 'request_id': 'req-89de96b1-98df-4c1b-8cb3-9400407b6efa'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.187728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc22ba6dc244a1aa7b8639555e5a1d1', 'request_id': 'req-89de96b1-98df-4c1b-8cb3-9400407b6efa'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.199692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] The token cache is being invalidate because project ccc22ba6dc244a1aa7b8639555e5a1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:18.199983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.200621 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.202135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1319/2645] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:18 2022] DELETE /identity/v3/projects/ccc22ba6dc244a1aa7b8639555e5a1d1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:18.206300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf461bc-20b9-4401-ac8b-3d2dc78d6146 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:18.216904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf461bc-20b9-4401-ac8b-3d2dc78d6146 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:18.272975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:18.273635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:18.273915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:18.274190 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] PATH_INFO: `/v3/users/d41a0ccf8c0d486f8b03f9789a7c348f` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:18.275304 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41a0ccf8c0d486f8b03f9789a7c348f)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:18.277208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:18.337047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41a0ccf8c0d486f8b03f9789a7c348f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.352832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41a0ccf8c0d486f8b03f9789a7c348f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.359651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41a0ccf8c0d486f8b03f9789a7c348f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.360458 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41a0ccf8c0d486f8b03f9789a7c348f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.367772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e5fc40ec-3e0b-4911-b225-8d0e24385661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41a0ccf8c0d486f8b03f9789a7c348f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.374116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1327/2646] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:18 2022] DELETE /identity/v3/users/d41a0ccf8c0d486f8b03f9789a7c348f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:18.634761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:18.636178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:18.661243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de96b1-98df-4c1b-8cb3-9400407b6efa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:18.737576 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:18.738000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:18.738280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:18.738549 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] PATH_INFO: `/v3/projects/8175c2b390e44d1ea0a32ff4d78da138` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:18.739724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8175c2b390e44d1ea0a32ff4d78da138)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:18.741629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:18.792802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8175c2b390e44d1ea0a32ff4d78da138', 'request_id': 'req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.798619 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8175c2b390e44d1ea0a32ff4d78da138', 'request_id': 'req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.805711 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8175c2b390e44d1ea0a32ff4d78da138', 'request_id': 'req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.807736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:18.823488 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] The token cache is being invalidate because project 8175c2b390e44d1ea0a32ff4d78da138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:18.823784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.824498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a947b96a-5f15-4a0d-a783-0dd22edfa1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:18.826636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1320/2647] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:18 2022] DELETE /identity/v3/projects/8175c2b390e44d1ea0a32ff4d78da138 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:18.835947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80625d1-c7cf-4d76-88aa-01692831b1ad None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:18.836443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80625d1-c7cf-4d76-88aa-01692831b1ad None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:18.836912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80625d1-c7cf-4d76-88aa-01692831b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:18.861352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f80625d1-c7cf-4d76-88aa-01692831b1ad None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:18.862612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f80625d1-c7cf-4d76-88aa-01692831b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:18.919884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:18.939433 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1328/2648] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:18.945542 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9bfd-64ed-47e7-8398-c1c03a1d601c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:18.945835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9bfd-64ed-47e7-8398-c1c03a1d601c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:18.946112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9bfd-64ed-47e7-8398-c1c03a1d601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:18.969257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-25af9bfd-64ed-47e7-8398-c1c03a1d601c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:18.970508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-25af9bfd-64ed-47e7-8398-c1c03a1d601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:18.978597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1321/2649] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:18.982896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80625d1-c7cf-4d76-88aa-01692831b1ad None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:18.993177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80625d1-c7cf-4d76-88aa-01692831b1ad None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:18.997832 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:18.998428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:18.998711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:18.998992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:18.999668 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:19.000002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:19.001620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:19.014041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1329/2650] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:19.018327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af9bfd-64ed-47e7-8398-c1c03a1d601c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:19.027840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af9bfd-64ed-47e7-8398-c1c03a1d601c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:19.032665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7e156-bd67-4570-af93-092f6fa6f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:19.033297 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7e156-bd67-4570-af93-092f6fa6f3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:19.033677 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7e156-bd67-4570-af93-092f6fa6f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:19.033950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7e156-bd67-4570-af93-092f6fa6f3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:19.034580 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7e156-bd67-4570-af93-092f6fa6f3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:19.036511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7e156-bd67-4570-af93-092f6fa6f3a7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:19.069649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1322/2651] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:19 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:19.074626 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:19.084879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb677328-352e-4d2b-b39e-c55576630332 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:19.145396 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed34842-c724-4a16-b17c-123870209c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:19.146023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed34842-c724-4a16-b17c-123870209c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:19.146302 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed34842-c724-4a16-b17c-123870209c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:19.146571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed34842-c724-4a16-b17c-123870209c89 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:19.147246 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed34842-c724-4a16-b17c-123870209c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:19.149142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed34842-c724-4a16-b17c-123870209c89 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:19.169769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1330/2652] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:19 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:19.174059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7e156-bd67-4570-af93-092f6fa6f3a7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:19.184927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7e156-bd67-4570-af93-092f6fa6f3a7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:19.189599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288a7ef-94b2-4f69-b2ae-0e00f6ba0168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:19.190197 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a7ef-94b2-4f69-b2ae-0e00f6ba0168 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:19.190481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a7ef-94b2-4f69-b2ae-0e00f6ba0168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:19.190757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288a7ef-94b2-4f69-b2ae-0e00f6ba0168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:19.191425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288a7ef-94b2-4f69-b2ae-0e00f6ba0168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:19.193817 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288a7ef-94b2-4f69-b2ae-0e00f6ba0168 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:19.203632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1323/2653] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:19.207505 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed34842-c724-4a16-b17c-123870209c89 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:19.217391 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed34842-c724-4a16-b17c-123870209c89 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:19.222080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dcdd7-72f7-4665-a986-60f3fc5308de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:19.222610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dcdd7-72f7-4665-a986-60f3fc5308de admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:19.222888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dcdd7-72f7-4665-a986-60f3fc5308de admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:19.223159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dcdd7-72f7-4665-a986-60f3fc5308de admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:19.223798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dcdd7-72f7-4665-a986-60f3fc5308de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:19.225385 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dcdd7-72f7-4665-a986-60f3fc5308de admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:19.236853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1331/2654] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:19.241359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288a7ef-94b2-4f69-b2ae-0e00f6ba0168 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:19.251194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288a7ef-94b2-4f69-b2ae-0e00f6ba0168 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:19.256840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:19.257670 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:19.257956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:19.258230 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] PATH_INFO: `/v3/projects/98b82bf37f7f497589d4e4a7957c0bec/users/a829191d447a41dd9fc2ad269e5db135/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:19.272874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b82bf37f7f497589d4e4a7957c0bec, user_id=a829191d447a41dd9fc2ad269e5db135, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:19.275553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:19.287655 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1324/2655] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:19 2022] PUT /identity/v3/projects/98b82bf37f7f497589d4e4a7957c0bec/users/a829191d447a41dd9fc2ad269e5db135/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:19.358297 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89ae6d-74ee-4f34-943c-42366e2e0442 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:19.358585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89ae6d-74ee-4f34-943c-42366e2e0442 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:19.358883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89ae6d-74ee-4f34-943c-42366e2e0442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:19.390187 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9a89ae6d-74ee-4f34-943c-42366e2e0442 None None] MFA Rules not processed for user `a829191d447a41dd9fc2ad269e5db135`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:19.391423 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a89ae6d-74ee-4f34-943c-42366e2e0442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:19.462082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1332/2656] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:19.474523 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:19.476131 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:19.533073 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f2cd3-b94a-4617-9be1-f9846e1dd298 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:19.537320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602f578-6ce8-472b-bf4d-01604d35dede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:19.537962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f578-6ce8-472b-bf4d-01604d35dede service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:19.538240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f578-6ce8-472b-bf4d-01604d35dede service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:19.538510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602f578-6ce8-472b-bf4d-01604d35dede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:19.546984 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602f578-6ce8-472b-bf4d-01604d35dede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:19.548443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602f578-6ce8-472b-bf4d-01604d35dede service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:19.557847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1325/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:19.986452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89ae6d-74ee-4f34-943c-42366e2e0442 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:19.987913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a89ae6d-74ee-4f34-943c-42366e2e0442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:20.000876 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89ae6d-74ee-4f34-943c-42366e2e0442 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:20.004901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1685f1c-06db-411d-8d89-573f3fd8f80d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:20.005530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685f1c-06db-411d-8d89-573f3fd8f80d service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:20.005814 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685f1c-06db-411d-8d89-573f3fd8f80d service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:20.006089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685f1c-06db-411d-8d89-573f3fd8f80d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:20.007884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-d1685f1c-06db-411d-8d89-573f3fd8f80d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:20.060432 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:20.077147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1685f1c-06db-411d-8d89-573f3fd8f80d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:20.078620 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1685f1c-06db-411d-8d89-573f3fd8f80d service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:20.088745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1333/2658] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:19:24.531608 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602f578-6ce8-472b-bf4d-01604d35dede service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:24.594381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602f578-6ce8-472b-bf4d-01604d35dede service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:24.598939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:24.599565 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:24.599850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:24.600123 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] PATH_INFO: `/v3/users/a829191d447a41dd9fc2ad269e5db135` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:24.601233 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a829191d447a41dd9fc2ad269e5db135)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:24.603193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:24.639134 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=3,keystone:DELETE=6,keystone:SELECT=91 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:24.653853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a829191d447a41dd9fc2ad269e5db135'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:24.660799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a829191d447a41dd9fc2ad269e5db135'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:24.672767 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a829191d447a41dd9fc2ad269e5db135'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:24.673466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a829191d447a41dd9fc2ad269e5db135'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:24.680587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a829191d447a41dd9fc2ad269e5db135'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:24.686754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1326/2659] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:24 2022] DELETE /identity/v3/users/a829191d447a41dd9fc2ad269e5db135 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:24.691369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15879-f0cf-4bfb-afe9-ebb3b53a1943 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:24.691847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15879-f0cf-4bfb-afe9-ebb3b53a1943 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:24.691975 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f15879-f0cf-4bfb-afe9-ebb3b53a1943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:24.712225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-e8f15879-f0cf-4bfb-afe9-ebb3b53a1943 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:24.713491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e8f15879-f0cf-4bfb-afe9-ebb3b53a1943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:24.772746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1334/2660] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:24.782393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:24.783793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:24.840118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798f5f7-b0cf-4341-9a5e-ae11378592e1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:24.843753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82758a2-d43e-4442-a915-4d09af5519ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:24.844348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82758a2-d43e-4442-a915-4d09af5519ee service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:24.844627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82758a2-d43e-4442-a915-4d09af5519ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:24.844903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82758a2-d43e-4442-a915-4d09af5519ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:24.853726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82758a2-d43e-4442-a915-4d09af5519ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:24.855144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82758a2-d43e-4442-a915-4d09af5519ee service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:24.864366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1327/2661] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:25.130436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15879-f0cf-4bfb-afe9-ebb3b53a1943 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:25.131877 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-e8f15879-f0cf-4bfb-afe9-ebb3b53a1943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:25.152961 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f15879-f0cf-4bfb-afe9-ebb3b53a1943 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:25.158274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:25.158928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.159205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.159529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] PATH_INFO: `/v3/projects/98b82bf37f7f497589d4e4a7957c0bec` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.160683 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b82bf37f7f497589d4e4a7957c0bec)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:25.163218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:25.212200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b82bf37f7f497589d4e4a7957c0bec', 'request_id': 'req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:25.219674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b82bf37f7f497589d4e4a7957c0bec', 'request_id': 'req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:25.226191 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b82bf37f7f497589d4e4a7957c0bec', 'request_id': 'req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:25.237555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] The token cache is being invalidate because project 98b82bf37f7f497589d4e4a7957c0bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:25.237970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:25.238624 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-e4a63eb4-c6e3-44d4-84b1-2300f732f82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:25.240473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1335/2662] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:25 2022] DELETE /identity/v3/projects/98b82bf37f7f497589d4e4a7957c0bec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:25.245780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78932f-0ea4-4edb-add5-66af72c55099 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.246068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78932f-0ea4-4edb-add5-66af72c55099 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.246342 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78932f-0ea4-4edb-add5-66af72c55099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.266172 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dd78932f-0ea4-4edb-add5-66af72c55099 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:25.267362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dd78932f-0ea4-4edb-add5-66af72c55099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:25.332669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1328/2663] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:25.340879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcd695-1872-491e-bc62-202adf4ceaf2 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.341298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcd695-1872-491e-bc62-202adf4ceaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.341705 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcd695-1872-491e-bc62-202adf4ceaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.365163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-07bcd695-1872-491e-bc62-202adf4ceaf2 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:25.366408 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-07bcd695-1872-491e-bc62-202adf4ceaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:25.374708 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1336/2664] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:25.379480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78932f-0ea4-4edb-add5-66af72c55099 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:25.389083 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78932f-0ea4-4edb-add5-66af72c55099 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:25.393944 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:25.394533 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.394809 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.395076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.395735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:25.396033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:25.397638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:25.408911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1329/2665] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:25.413671 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcd695-1872-491e-bc62-202adf4ceaf2 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:25.422921 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcd695-1872-491e-bc62-202adf4ceaf2 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:25.428198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec544f6c-d51f-406f-a867-0141ac04636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:25.428793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec544f6c-d51f-406f-a867-0141ac04636e admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.429078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec544f6c-d51f-406f-a867-0141ac04636e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.429351 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec544f6c-d51f-406f-a867-0141ac04636e admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.430047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec544f6c-d51f-406f-a867-0141ac04636e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:25.431924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec544f6c-d51f-406f-a867-0141ac04636e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:25.457794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1337/2666] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:25 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:25.462113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:25.472103 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade22d-366b-4dd4-9d71-bba83342a7b9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:25.511106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:25.531158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141666b-3ad2-4c33-ad79-a2258dcb26e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:25.531795 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141666b-3ad2-4c33-ad79-a2258dcb26e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.532306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141666b-3ad2-4c33-ad79-a2258dcb26e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.532306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141666b-3ad2-4c33-ad79-a2258dcb26e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.532955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141666b-3ad2-4c33-ad79-a2258dcb26e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:25.534919 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141666b-3ad2-4c33-ad79-a2258dcb26e4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:25.556187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1330/2667] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:25 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:25.560395 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec544f6c-d51f-406f-a867-0141ac04636e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:25.571306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec544f6c-d51f-406f-a867-0141ac04636e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:25.575926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3756-2155-4059-b306-6fbc002b9315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:25.576523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3756-2155-4059-b306-6fbc002b9315 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.576802 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3756-2155-4059-b306-6fbc002b9315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.577077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3756-2155-4059-b306-6fbc002b9315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.577752 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3756-2155-4059-b306-6fbc002b9315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:25.579335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3756-2155-4059-b306-6fbc002b9315 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:25.590141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1338/2668] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:25.594046 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141666b-3ad2-4c33-ad79-a2258dcb26e4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:25.603963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141666b-3ad2-4c33-ad79-a2258dcb26e4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:25.608553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271071-7eaf-4b36-9121-6bb9e62858fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:25.609137 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271071-7eaf-4b36-9121-6bb9e62858fb admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.609433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271071-7eaf-4b36-9121-6bb9e62858fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.609718 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271071-7eaf-4b36-9121-6bb9e62858fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.610352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75271071-7eaf-4b36-9121-6bb9e62858fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:25.611923 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75271071-7eaf-4b36-9121-6bb9e62858fb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:25.622331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1331/2669] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:25.626413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3756-2155-4059-b306-6fbc002b9315 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:25.637983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3756-2155-4059-b306-6fbc002b9315 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:25.643834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:25.644965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.645454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.646470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] PATH_INFO: `/v3/projects/7a933c142e1f48d6be283289eca5940a/users/c377afe8e83944c3887614b4c858337c/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.661706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a933c142e1f48d6be283289eca5940a, user_id=c377afe8e83944c3887614b4c858337c, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:25.664357 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:25.677782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1339/2670] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:25 2022] PUT /identity/v3/projects/7a933c142e1f48d6be283289eca5940a/users/c377afe8e83944c3887614b4c858337c/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:25.682866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ca2a-a9da-4c15-87ed-955d466ef7cb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.683152 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ca2a-a9da-4c15-87ed-955d466ef7cb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.683537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ca2a-a9da-4c15-87ed-955d466ef7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.702706 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9977ca2a-a9da-4c15-87ed-955d466ef7cb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:25.703900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9977ca2a-a9da-4c15-87ed-955d466ef7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:25.760768 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1332/2671] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:25.770579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:25.772282 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:25.778816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:25.831641 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23319427-dbd4-4ae8-b7ab-08c7626b14a7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:25.835271 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce583f0-3355-436b-b3ed-6f80a354db34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:25.835870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce583f0-3355-436b-b3ed-6f80a354db34 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:25.836145 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce583f0-3355-436b-b3ed-6f80a354db34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:25.836415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce583f0-3355-436b-b3ed-6f80a354db34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:25.845179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce583f0-3355-436b-b3ed-6f80a354db34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:25.846638 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce583f0-3355-436b-b3ed-6f80a354db34 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:25.855860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1340/2672] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:29.988045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b524be3-a3eb-4b3f-8017-fabd49779d9b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:29.988561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b524be3-a3eb-4b3f-8017-fabd49779d9b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:29.988684 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b524be3-a3eb-4b3f-8017-fabd49779d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:30.019614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1b524be3-a3eb-4b3f-8017-fabd49779d9b None None] MFA Rules not processed for user `c377afe8e83944c3887614b4c858337c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:30.021615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1b524be3-a3eb-4b3f-8017-fabd49779d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:30.092156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1333/2673] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:30.096879 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce583f0-3355-436b-b3ed-6f80a354db34 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:30.106855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce583f0-3355-436b-b3ed-6f80a354db34 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:30.111699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fa3e2-c6e8-4ffc-88f6-8cb00d2138e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:30.112509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fa3e2-c6e8-4ffc-88f6-8cb00d2138e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:30.112971 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fa3e2-c6e8-4ffc-88f6-8cb00d2138e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:30.113476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fa3e2-c6e8-4ffc-88f6-8cb00d2138e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:30.114358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fa3e2-c6e8-4ffc-88f6-8cb00d2138e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:30.116024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fa3e2-c6e8-4ffc-88f6-8cb00d2138e9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:30.153224 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1341/2674] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:30 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:30.157205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b524be3-a3eb-4b3f-8017-fabd49779d9b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:30.169656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b524be3-a3eb-4b3f-8017-fabd49779d9b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:30.224358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:30.237858 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aea70d-7376-450e-b128-f4c6d62b7a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:30.238476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aea70d-7376-450e-b128-f4c6d62b7a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:30.238760 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aea70d-7376-450e-b128-f4c6d62b7a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:30.239039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aea70d-7376-450e-b128-f4c6d62b7a21 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:30.239722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aea70d-7376-450e-b128-f4c6d62b7a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:30.241719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aea70d-7376-450e-b128-f4c6d62b7a21 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:30.268033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1334/2675] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:30 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:30.272732 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fa3e2-c6e8-4ffc-88f6-8cb00d2138e9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:30.290539 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fa3e2-c6e8-4ffc-88f6-8cb00d2138e9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:30.296110 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399f171-b781-4909-898c-5419e68a58ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:30.296741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399f171-b781-4909-898c-5419e68a58ed admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:30.297013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399f171-b781-4909-898c-5419e68a58ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:30.297286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399f171-b781-4909-898c-5419e68a58ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:30.298028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399f171-b781-4909-898c-5419e68a58ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:30.300113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399f171-b781-4909-898c-5419e68a58ed admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:30.312535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1342/2676] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:30.318481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aea70d-7376-450e-b128-f4c6d62b7a21 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:30.328873 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aea70d-7376-450e-b128-f4c6d62b7a21 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:30.334522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d60936-7fb7-419b-b09c-59c99eaff371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:30.335201 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d60936-7fb7-419b-b09c-59c99eaff371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:30.335518 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d60936-7fb7-419b-b09c-59c99eaff371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:30.335824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d60936-7fb7-419b-b09c-59c99eaff371 admin admin] PATH_INFO: `/v3/projects/75a4d1288111443ab04fa3316ee91a9b/users/049f091bc2b94f5991cf8a5275986623/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:30.351990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d60936-7fb7-419b-b09c-59c99eaff371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a4d1288111443ab04fa3316ee91a9b, user_id=049f091bc2b94f5991cf8a5275986623, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:30.355628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d60936-7fb7-419b-b09c-59c99eaff371 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:30.372464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1335/2677] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:30 2022] PUT /identity/v3/projects/75a4d1288111443ab04fa3316ee91a9b/users/049f091bc2b94f5991cf8a5275986623/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:30.376670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399f171-b781-4909-898c-5419e68a58ed admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:30.387781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399f171-b781-4909-898c-5419e68a58ed admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:30.454340 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:30.454953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:30.455233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:30.455541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:30.456208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:30.457855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:30.482872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1343/2678] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:30.490104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d60936-7fb7-419b-b09c-59c99eaff371 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:30.506088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d60936-7fb7-419b-b09c-59c99eaff371 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:30.520433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5cd21-6f6f-41db-9de1-0edff5d89313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:30.521950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cd21-6f6f-41db-9de1-0edff5d89313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:30.522301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cd21-6f6f-41db-9de1-0edff5d89313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:30.522645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cd21-6f6f-41db-9de1-0edff5d89313 admin admin] PATH_INFO: `/v3/projects/75a4d1288111443ab04fa3316ee91a9b/users/049f091bc2b94f5991cf8a5275986623/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:30.524844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5cd21-6f6f-41db-9de1-0edff5d89313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a4d1288111443ab04fa3316ee91a9b, user_id=049f091bc2b94f5991cf8a5275986623, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:30.527755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5cd21-6f6f-41db-9de1-0edff5d89313 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:30.542350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1336/2679] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:30 2022] PUT /identity/v3/projects/75a4d1288111443ab04fa3316ee91a9b/users/049f091bc2b94f5991cf8a5275986623/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:32.876912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:32.879105 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:32.898024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2099f5-cf94-4a63-b217-421ca9495a9f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:33.032195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:33.032982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:33.033521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:33.033893 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] PATH_INFO: `/v3/users/06a805fadf1b42dea889ae82c6eed7e7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:33.035262 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a805fadf1b42dea889ae82c6eed7e7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:33.037313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:33.061179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:33.119508 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a805fadf1b42dea889ae82c6eed7e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:33.139046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a805fadf1b42dea889ae82c6eed7e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:33.173298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a805fadf1b42dea889ae82c6eed7e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:33.174483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a805fadf1b42dea889ae82c6eed7e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:33.189900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a805fadf1b42dea889ae82c6eed7e7'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:33.205123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1344/2680] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:32 2022] DELETE /identity/v3/users/06a805fadf1b42dea889ae82c6eed7e7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:33.210295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d54e43-de23-4125-8b1a-81cd43ba41a1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:33.210791 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d54e43-de23-4125-8b1a-81cd43ba41a1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:33.210992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d54e43-de23-4125-8b1a-81cd43ba41a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:33.237769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b5d54e43-de23-4125-8b1a-81cd43ba41a1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:33.239886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b5d54e43-de23-4125-8b1a-81cd43ba41a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:33.334492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1337/2681] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:33.346324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:33.358129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:33.483347 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b79ac0-7445-445c-bb80-c15a4035fd0a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:33.488763 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af073b8-a624-4af6-88e5-2ab2b62ea19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:33.489725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af073b8-a624-4af6-88e5-2ab2b62ea19b service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:33.490182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af073b8-a624-4af6-88e5-2ab2b62ea19b service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:33.490749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af073b8-a624-4af6-88e5-2ab2b62ea19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:33.526195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af073b8-a624-4af6-88e5-2ab2b62ea19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:33.526998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af073b8-a624-4af6-88e5-2ab2b62ea19b service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:33.560293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1345/2682] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:34.733890 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d54e43-de23-4125-8b1a-81cd43ba41a1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:34.742746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b5d54e43-de23-4125-8b1a-81cd43ba41a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:34.763874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d54e43-de23-4125-8b1a-81cd43ba41a1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:34.786620 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:34.788026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:34.788472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:34.788943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] PATH_INFO: `/v3/projects/1d3619b5e783401fb1cc178ea2aa8308` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:34.791702 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3619b5e783401fb1cc178ea2aa8308)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:34.794305 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:34.896562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3619b5e783401fb1cc178ea2aa8308', 'request_id': 'req-cb464053-0d4e-4f5c-bf1c-5b06188995ab'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:34.902843 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3619b5e783401fb1cc178ea2aa8308', 'request_id': 'req-cb464053-0d4e-4f5c-bf1c-5b06188995ab'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:34.909994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3619b5e783401fb1cc178ea2aa8308', 'request_id': 'req-cb464053-0d4e-4f5c-bf1c-5b06188995ab'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:34.929536 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] The token cache is being invalidate because project 1d3619b5e783401fb1cc178ea2aa8308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:34.929922 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:34.931274 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb464053-0d4e-4f5c-bf1c-5b06188995ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:34.932962 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1338/2683] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:34 2022] DELETE /identity/v3/projects/1d3619b5e783401fb1cc178ea2aa8308 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:34.937867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af073b8-a624-4af6-88e5-2ab2b62ea19b service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:34.951826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af073b8-a624-4af6-88e5-2ab2b62ea19b service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:35.031779 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:35.032512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:35.032896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:35.033172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] PATH_INFO: `/v3/users/f7e7827fc34d4570ba7c73d1bf9947db` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:35.035147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e7827fc34d4570ba7c73d1bf9947db)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:35.037179 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:35.158870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:35.173375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e7827fc34d4570ba7c73d1bf9947db'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.206227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e7827fc34d4570ba7c73d1bf9947db'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.230013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e7827fc34d4570ba7c73d1bf9947db'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.232416 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e7827fc34d4570ba7c73d1bf9947db'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.240855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e7827fc34d4570ba7c73d1bf9947db'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.253996 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1346/2684] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:34 2022] DELETE /identity/v3/users/f7e7827fc34d4570ba7c73d1bf9947db => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:35.647418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995497ae-a72b-4f8b-ae96-856f3a494247 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:35.647700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995497ae-a72b-4f8b-ae96-856f3a494247 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:35.647980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995497ae-a72b-4f8b-ae96-856f3a494247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:35.695068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:35.696734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-995497ae-a72b-4f8b-ae96-856f3a494247 None None] MFA Rules not processed for user `049f091bc2b94f5991cf8a5275986623`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:35.698390 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-995497ae-a72b-4f8b-ae96-856f3a494247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:35.698525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:35.718530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:35.778485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb95f8-e3dc-4c1c-a3a6-bc9ccf094ec6 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:35.786174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:35.787035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:35.792654 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1339/2685] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:35.796274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:35.796707 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] PATH_INFO: `/v3/projects/6d727b81a2b84c0ea6bea8e3e6d87910` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:35.798219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d727b81a2b84c0ea6bea8e3e6d87910)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:35.800266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:35.814562 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995497ae-a72b-4f8b-ae96-856f3a494247 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:35.816801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-995497ae-a72b-4f8b-ae96-856f3a494247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:35.866529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d727b81a2b84c0ea6bea8e3e6d87910', 'request_id': 'req-36056fd4-9f40-4178-97c5-6f2b39329971'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.876565 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d727b81a2b84c0ea6bea8e3e6d87910', 'request_id': 'req-36056fd4-9f40-4178-97c5-6f2b39329971'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.885257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d727b81a2b84c0ea6bea8e3e6d87910', 'request_id': 'req-36056fd4-9f40-4178-97c5-6f2b39329971'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.900874 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] The token cache is being invalidate because project 6d727b81a2b84c0ea6bea8e3e6d87910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:35.901312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.902094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-36056fd4-9f40-4178-97c5-6f2b39329971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:35.903978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1347/2686] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:35 2022] DELETE /identity/v3/projects/6d727b81a2b84c0ea6bea8e3e6d87910 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:35.905338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995497ae-a72b-4f8b-ae96-856f3a494247 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:35.908375 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368aa08-fa4e-415e-b82c-57a33f522f3c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:35.908666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368aa08-fa4e-415e-b82c-57a33f522f3c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:35.909088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368aa08-fa4e-415e-b82c-57a33f522f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:35.932674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f368aa08-fa4e-415e-b82c-57a33f522f3c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:35.933944 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f368aa08-fa4e-415e-b82c-57a33f522f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:35.977917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:35.979179 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:35.979463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:35.979742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:35.980281 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:35.982336 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:36.002672 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1348/2687] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:36.010842 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec943-ea84-481e-9f1e-9bc5c9dd70ed None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.011129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec943-ea84-481e-9f1e-9bc5c9dd70ed None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.011404 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec943-ea84-481e-9f1e-9bc5c9dd70ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.031729 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-1f5ec943-ea84-481e-9f1e-9bc5c9dd70ed None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:36.032723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:36.032938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1f5ec943-ea84-481e-9f1e-9bc5c9dd70ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:36.041716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1349/2688] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:36.045935 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ec943-ea84-481e-9f1e-9bc5c9dd70ed None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.048605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.050237 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.055651 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ec943-ea84-481e-9f1e-9bc5c9dd70ed None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.060212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1340/2689] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:36.060435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.061076 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.061360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.061667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.062325 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:36.062606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.064182 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.077438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1350/2690] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 01:19:36.081092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.091835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f01b-2543-462d-ad5e-1cbf55fe129f service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.096693 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3700254-de8f-4b1f-baf1-5f05a6aa000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.097298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3700254-de8f-4b1f-baf1-5f05a6aa000b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.097636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3700254-de8f-4b1f-baf1-5f05a6aa000b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.097917 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3700254-de8f-4b1f-baf1-5f05a6aa000b admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.099069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3700254-de8f-4b1f-baf1-5f05a6aa000b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.100969 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3700254-de8f-4b1f-baf1-5f05a6aa000b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.138178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1341/2691] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:36 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:36.142677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.155587 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814c1c9-88f9-4575-bc80-075c6e78f350 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.219010 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ef70-6cfa-4216-a833-358199540c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.219623 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ef70-6cfa-4216-a833-358199540c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.219904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ef70-6cfa-4216-a833-358199540c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.220177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ef70-6cfa-4216-a833-358199540c7f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.220862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ef70-6cfa-4216-a833-358199540c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.223072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ef70-6cfa-4216-a833-358199540c7f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.246077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1351/2692] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:36 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:36.250669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3700254-de8f-4b1f-baf1-5f05a6aa000b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.266074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3700254-de8f-4b1f-baf1-5f05a6aa000b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.273943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85935e-40fd-4365-bf2f-07d54529e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.274569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85935e-40fd-4365-bf2f-07d54529e3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.274835 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85935e-40fd-4365-bf2f-07d54529e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.275110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85935e-40fd-4365-bf2f-07d54529e3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.275833 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85935e-40fd-4365-bf2f-07d54529e3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.277573 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85935e-40fd-4365-bf2f-07d54529e3f8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.289732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1342/2693] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:36.294164 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ef70-6cfa-4216-a833-358199540c7f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.306045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ef70-6cfa-4216-a833-358199540c7f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.310860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c044f-9547-4572-b79e-8142f7859844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.311517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c044f-9547-4572-b79e-8142f7859844 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.311799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c044f-9547-4572-b79e-8142f7859844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.312070 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c044f-9547-4572-b79e-8142f7859844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.312784 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c044f-9547-4572-b79e-8142f7859844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.314481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c044f-9547-4572-b79e-8142f7859844 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.326654 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1352/2694] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:36.330985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85935e-40fd-4365-bf2f-07d54529e3f8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.340908 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85935e-40fd-4365-bf2f-07d54529e3f8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.347159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153953f9-c497-4160-a04e-6abb02c6eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.347882 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153953f9-c497-4160-a04e-6abb02c6eb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.348108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153953f9-c497-4160-a04e-6abb02c6eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.348417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153953f9-c497-4160-a04e-6abb02c6eb4c admin admin] PATH_INFO: `/v3/projects/d67e34c58643433b9e91f53f33e7d88b/users/d466fd917b4d4c2db1cae504f56fb6b2/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.365595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153953f9-c497-4160-a04e-6abb02c6eb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67e34c58643433b9e91f53f33e7d88b, user_id=d466fd917b4d4c2db1cae504f56fb6b2, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.368256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153953f9-c497-4160-a04e-6abb02c6eb4c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.381829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1343/2695] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:36 2022] PUT /identity/v3/projects/d67e34c58643433b9e91f53f33e7d88b/users/d466fd917b4d4c2db1cae504f56fb6b2/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:36.393625 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd5c7-3858-4462-830c-49c839a26fe4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.393982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd5c7-3858-4462-830c-49c839a26fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.394249 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd5c7-3858-4462-830c-49c839a26fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.428113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-220fd5c7-3858-4462-830c-49c839a26fe4 None None] MFA Rules not processed for user `d466fd917b4d4c2db1cae504f56fb6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:36.429473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-220fd5c7-3858-4462-830c-49c839a26fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:36.527953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1353/2696] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:36.528604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153953f9-c497-4160-a04e-6abb02c6eb4c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.639602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153953f9-c497-4160-a04e-6abb02c6eb4c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.647238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1b064-54b3-48e5-96c9-0f47e706b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.647874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b064-54b3-48e5-96c9-0f47e706b360 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.648151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b064-54b3-48e5-96c9-0f47e706b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.648423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b064-54b3-48e5-96c9-0f47e706b360 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.649077 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1b064-54b3-48e5-96c9-0f47e706b360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.651186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1b064-54b3-48e5-96c9-0f47e706b360 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.688638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1344/2697] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:36 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:36.696195 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd5c7-3858-4462-830c-49c839a26fe4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.707480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd5c7-3858-4462-830c-49c839a26fe4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.756696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:36.796030 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5f804-9c36-47b9-82ce-e36719aee79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.797202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f804-9c36-47b9-82ce-e36719aee79f admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.797591 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f804-9c36-47b9-82ce-e36719aee79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.797933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f804-9c36-47b9-82ce-e36719aee79f admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.798662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5f804-9c36-47b9-82ce-e36719aee79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.800656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5f804-9c36-47b9-82ce-e36719aee79f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.831819 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1354/2698] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:36 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:36.837511 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1b064-54b3-48e5-96c9-0f47e706b360 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.852778 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1b064-54b3-48e5-96c9-0f47e706b360 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.859771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f673ae-5b8c-4bfb-876b-f7b03b00732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.860732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f673ae-5b8c-4bfb-876b-f7b03b00732e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.861016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f673ae-5b8c-4bfb-876b-f7b03b00732e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.861847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f673ae-5b8c-4bfb-876b-f7b03b00732e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.862570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f673ae-5b8c-4bfb-876b-f7b03b00732e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.864961 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f673ae-5b8c-4bfb-876b-f7b03b00732e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.880255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1345/2699] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:36.881691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5f804-9c36-47b9-82ce-e36719aee79f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.893633 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5f804-9c36-47b9-82ce-e36719aee79f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:36.901088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ecbe-9822-4512-b316-04d1902f8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:36.901947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ecbe-9822-4512-b316-04d1902f8e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:36.902311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ecbe-9822-4512-b316-04d1902f8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:36.903103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ecbe-9822-4512-b316-04d1902f8e2b admin admin] PATH_INFO: `/v3/projects/13e375563e09415786e18e9af1abb191/users/4aee7762b86a45eebec7c23ab7c720a4/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:36.929855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359ecbe-9822-4512-b316-04d1902f8e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e375563e09415786e18e9af1abb191, user_id=4aee7762b86a45eebec7c23ab7c720a4, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:36.932829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359ecbe-9822-4512-b316-04d1902f8e2b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:36.949901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1355/2700] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:36 2022] PUT /identity/v3/projects/13e375563e09415786e18e9af1abb191/users/4aee7762b86a45eebec7c23ab7c720a4/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:36.954298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f673ae-5b8c-4bfb-876b-f7b03b00732e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:36.976669 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f673ae-5b8c-4bfb-876b-f7b03b00732e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:37.056412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40514a87-a617-4ffa-9e91-c38fc9d3cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:37.057492 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514a87-a617-4ffa-9e91-c38fc9d3cfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:37.057639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514a87-a617-4ffa-9e91-c38fc9d3cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:37.057883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514a87-a617-4ffa-9e91-c38fc9d3cfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:37.058966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514a87-a617-4ffa-9e91-c38fc9d3cfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:37.060639 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514a87-a617-4ffa-9e91-c38fc9d3cfb0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:37.063527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:37.074121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1346/2701] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:37.078226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ecbe-9822-4512-b316-04d1902f8e2b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:37.090138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ecbe-9822-4512-b316-04d1902f8e2b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:37.095148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7b722-6338-4779-8806-7a6332f06079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:37.095888 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b722-6338-4779-8806-7a6332f06079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:37.096174 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b722-6338-4779-8806-7a6332f06079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:37.096450 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b722-6338-4779-8806-7a6332f06079 admin admin] PATH_INFO: `/v3/projects/13e375563e09415786e18e9af1abb191/users/4aee7762b86a45eebec7c23ab7c720a4/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:37.099334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7b722-6338-4779-8806-7a6332f06079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e375563e09415786e18e9af1abb191, user_id=4aee7762b86a45eebec7c23ab7c720a4, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:37.102138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7b722-6338-4779-8806-7a6332f06079 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:37.117476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1356/2702] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:37 2022] PUT /identity/v3/projects/13e375563e09415786e18e9af1abb191/users/4aee7762b86a45eebec7c23ab7c720a4/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:37.124616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b234843-abc8-41e7-87e2-94e68a8ca07b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:37.124903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b234843-abc8-41e7-87e2-94e68a8ca07b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:37.125178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b234843-abc8-41e7-87e2-94e68a8ca07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:37.157966 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9b234843-abc8-41e7-87e2-94e68a8ca07b None None] MFA Rules not processed for user `4aee7762b86a45eebec7c23ab7c720a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:37.159227 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9b234843-abc8-41e7-87e2-94e68a8ca07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:37.201747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd61f4-77c9-4d39-94c7-b1af06df0011 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:37.202033 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd61f4-77c9-4d39-94c7-b1af06df0011 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:37.202310 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd61f4-77c9-4d39-94c7-b1af06df0011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:37.221535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a0dd61f4-77c9-4d39-94c7-b1af06df0011 None None] MFA Rules not processed for user `c377afe8e83944c3887614b4c858337c`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:37.222759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a0dd61f4-77c9-4d39-94c7-b1af06df0011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:37.249631 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1347/2703] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:37.263276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b234843-abc8-41e7-87e2-94e68a8ca07b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:37.265223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9b234843-abc8-41e7-87e2-94e68a8ca07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:37.289207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1357/2704] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:37.332169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b234843-abc8-41e7-87e2-94e68a8ca07b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:37.336755 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e663c8-f771-4403-85de-02afd387f4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:37.337587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e663c8-f771-4403-85de-02afd387f4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:37.337888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e663c8-f771-4403-85de-02afd387f4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:37.338153 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e663c8-f771-4403-85de-02afd387f4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:37.348810 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e663c8-f771-4403-85de-02afd387f4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:37.350296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e663c8-f771-4403-85de-02afd387f4c6 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:37.361469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1348/2705] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:37.803087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd61f4-77c9-4d39-94c7-b1af06df0011 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:37.874413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd61f4-77c9-4d39-94c7-b1af06df0011 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:37.880367 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:37.881004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:37.881286 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:37.881597 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] PATH_INFO: `/v3/users/d466fd917b4d4c2db1cae504f56fb6b2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:37.882735 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d466fd917b4d4c2db1cae504f56fb6b2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:37.884711 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:37.923454 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:37.939206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd466fd917b4d4c2db1cae504f56fb6b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:37.951691 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd466fd917b4d4c2db1cae504f56fb6b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:37.960139 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd466fd917b4d4c2db1cae504f56fb6b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:37.960943 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd466fd917b4d4c2db1cae504f56fb6b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:37.971916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd466fd917b4d4c2db1cae504f56fb6b2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:37.979381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1358/2706] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:37 2022] DELETE /identity/v3/users/d466fd917b4d4c2db1cae504f56fb6b2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:37.984182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ddf7-42b5-41aa-a42c-02b4787e9ca1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:37.984695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ddf7-42b5-41aa-a42c-02b4787e9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:37.984911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ddf7-42b5-41aa-a42c-02b4787e9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:38.007537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1497ddf7-42b5-41aa-a42c-02b4787e9ca1 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:38.008751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1497ddf7-42b5-41aa-a42c-02b4787e9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:38.081963 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1349/2707] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:19:38.092300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:38.093799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:38.181228 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b95354-b0a7-4193-b98c-5da3cf339381 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:38.185376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ddee-3af9-4625-b0ab-577be346a54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:38.186097 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ddee-3af9-4625-b0ab-577be346a54c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:38.186596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ddee-3af9-4625-b0ab-577be346a54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:38.186929 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ddee-3af9-4625-b0ab-577be346a54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:38.197119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ddee-3af9-4625-b0ab-577be346a54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:38.200238 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ddee-3af9-4625-b0ab-577be346a54c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:38.215415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1359/2708] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:38.545566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497ddf7-42b5-41aa-a42c-02b4787e9ca1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:38.547279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1497ddf7-42b5-41aa-a42c-02b4787e9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:38.559692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497ddf7-42b5-41aa-a42c-02b4787e9ca1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:38.564605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:38.565240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:38.565548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:38.565821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] PATH_INFO: `/v3/projects/d67e34c58643433b9e91f53f33e7d88b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:38.566931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67e34c58643433b9e91f53f33e7d88b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:38.569034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:38.594591 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:38.622009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67e34c58643433b9e91f53f33e7d88b', 'request_id': 'req-f885dea5-b72f-4d30-8ca9-863411f5d1e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.628469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67e34c58643433b9e91f53f33e7d88b', 'request_id': 'req-f885dea5-b72f-4d30-8ca9-863411f5d1e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.637737 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67e34c58643433b9e91f53f33e7d88b', 'request_id': 'req-f885dea5-b72f-4d30-8ca9-863411f5d1e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.663553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] The token cache is being invalidate because project d67e34c58643433b9e91f53f33e7d88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:38.664360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.665214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.667949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1350/2709] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:38 2022] DELETE /identity/v3/projects/d67e34c58643433b9e91f53f33e7d88b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:38.678114 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ddee-3af9-4625-b0ab-577be346a54c service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:38.694917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ddee-3af9-4625-b0ab-577be346a54c service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:38.785706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:38.786412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:38.786699 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:38.786980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] PATH_INFO: `/v3/users/4aee7762b86a45eebec7c23ab7c720a4` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:38.790236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aee7762b86a45eebec7c23ab7c720a4)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:38.792261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:38.851431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aee7762b86a45eebec7c23ab7c720a4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.858449 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:38.870177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aee7762b86a45eebec7c23ab7c720a4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.878354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aee7762b86a45eebec7c23ab7c720a4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.878981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aee7762b86a45eebec7c23ab7c720a4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.886740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d6e7de1-091c-44dd-9b99-ddbe317e17e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aee7762b86a45eebec7c23ab7c720a4'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:38.894124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1360/2710] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:38 2022] DELETE /identity/v3/users/4aee7762b86a45eebec7c23ab7c720a4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:39.206304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:39.211086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:39.233232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885dea5-b72f-4d30-8ca9-863411f5d1e5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:39.295255 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:39.295879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.296158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.296429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] PATH_INFO: `/v3/projects/13e375563e09415786e18e9af1abb191` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.297579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e375563e09415786e18e9af1abb191)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:39.299606 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:39.346552 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e375563e09415786e18e9af1abb191', 'request_id': 'req-befcf736-1412-438f-80f7-31609599d77f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:39.353049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e375563e09415786e18e9af1abb191', 'request_id': 'req-befcf736-1412-438f-80f7-31609599d77f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:39.362092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e375563e09415786e18e9af1abb191', 'request_id': 'req-befcf736-1412-438f-80f7-31609599d77f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:39.378701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] The token cache is being invalidate because project 13e375563e09415786e18e9af1abb191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:39.379017 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:39.379758 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befcf736-1412-438f-80f7-31609599d77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:39.381358 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1351/2711] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:39 2022] DELETE /identity/v3/projects/13e375563e09415786e18e9af1abb191 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:39.387360 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa700ec-00a9-4d66-bcb4-6eeff1d7942e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.387883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa700ec-00a9-4d66-bcb4-6eeff1d7942e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.387991 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa700ec-00a9-4d66-bcb4-6eeff1d7942e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.407795 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9fa700ec-00a9-4d66-bcb4-6eeff1d7942e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:39.408982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9fa700ec-00a9-4d66-bcb4-6eeff1d7942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:39.478350 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1361/2712] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:39.488733 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cd19-4e80-4384-aaa9-8012d91254cc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.489034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cd19-4e80-4384-aaa9-8012d91254cc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.489379 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cd19-4e80-4384-aaa9-8012d91254cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.516287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8358cd19-4e80-4384-aaa9-8012d91254cc None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:39.517634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8358cd19-4e80-4384-aaa9-8012d91254cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:39.526686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1352/2713] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:39.531204 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa700ec-00a9-4d66-bcb4-6eeff1d7942e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:39.541955 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa700ec-00a9-4d66-bcb4-6eeff1d7942e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:39.546519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:39.547123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.547412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.547688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.548335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:39.548640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:39.550274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:39.561784 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1362/2714] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:39.565886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358cd19-4e80-4384-aaa9-8012d91254cc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:39.575682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358cd19-4e80-4384-aaa9-8012d91254cc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:39.580309 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad937f-5e92-457a-af85-19155fff6fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:39.580930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad937f-5e92-457a-af85-19155fff6fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.581212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad937f-5e92-457a-af85-19155fff6fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.581515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad937f-5e92-457a-af85-19155fff6fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.582151 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad937f-5e92-457a-af85-19155fff6fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:39.584736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad937f-5e92-457a-af85-19155fff6fa7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:39.611014 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1353/2715] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:39 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:39.615155 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:39.625231 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37a9d5-d4cd-48ae-9462-05b1474c40a9 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:39.684208 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55384a-3f0f-46ec-9619-126a40fe3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:39.684817 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55384a-3f0f-46ec-9619-126a40fe3428 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.685103 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55384a-3f0f-46ec-9619-126a40fe3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.685388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55384a-3f0f-46ec-9619-126a40fe3428 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.686058 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55384a-3f0f-46ec-9619-126a40fe3428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:39.687982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55384a-3f0f-46ec-9619-126a40fe3428 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:39.710255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1363/2716] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:39 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:39.715860 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad937f-5e92-457a-af85-19155fff6fa7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:39.727876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad937f-5e92-457a-af85-19155fff6fa7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:39.732510 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ca3f1-3a0f-4ed9-b2ef-f5c178710368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:39.733104 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ca3f1-3a0f-4ed9-b2ef-f5c178710368 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.733430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ca3f1-3a0f-4ed9-b2ef-f5c178710368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.733709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ca3f1-3a0f-4ed9-b2ef-f5c178710368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.734341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ca3f1-3a0f-4ed9-b2ef-f5c178710368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:39.735916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ca3f1-3a0f-4ed9-b2ef-f5c178710368 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:39.741049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:39.746412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1354/2717] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:39.750529 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55384a-3f0f-46ec-9619-126a40fe3428 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:39.762443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55384a-3f0f-46ec-9619-126a40fe3428 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:39.767694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589b6e6-0b15-4c48-9b1d-a458701b8268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:39.768324 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b6e6-0b15-4c48-9b1d-a458701b8268 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.768613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b6e6-0b15-4c48-9b1d-a458701b8268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.768886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b6e6-0b15-4c48-9b1d-a458701b8268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.769569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589b6e6-0b15-4c48-9b1d-a458701b8268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:39.771845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589b6e6-0b15-4c48-9b1d-a458701b8268 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:39.784329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1364/2718] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:39.789896 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ca3f1-3a0f-4ed9-b2ef-f5c178710368 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:39.809920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ca3f1-3a0f-4ed9-b2ef-f5c178710368 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:39.825015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5d249-fa9e-4b4b-a630-d271eb444187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:39.825740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5d249-fa9e-4b4b-a630-d271eb444187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.826057 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5d249-fa9e-4b4b-a630-d271eb444187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.826333 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5d249-fa9e-4b4b-a630-d271eb444187 admin admin] PATH_INFO: `/v3/projects/346aa1aa094d4be0abd7336796683941/users/3e9e60346e8f434fbb188f51ef76e6c2/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.846883 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5d249-fa9e-4b4b-a630-d271eb444187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346aa1aa094d4be0abd7336796683941, user_id=3e9e60346e8f434fbb188f51ef76e6c2, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:39.849700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5d249-fa9e-4b4b-a630-d271eb444187 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:39.864035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1355/2719] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:39 2022] PUT /identity/v3/projects/346aa1aa094d4be0abd7336796683941/users/3e9e60346e8f434fbb188f51ef76e6c2/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:39.874163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e288-aa70-428a-9f92-712f127ef0c5 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:39.874452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e288-aa70-428a-9f92-712f127ef0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:39.874772 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e288-aa70-428a-9f92-712f127ef0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:39.907637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ee29e288-aa70-428a-9f92-712f127ef0c5 None None] MFA Rules not processed for user `3e9e60346e8f434fbb188f51ef76e6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:39.908867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ee29e288-aa70-428a-9f92-712f127ef0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:39.935235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:39.978578 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1365/2720] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:39.984251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5d249-fa9e-4b4b-a630-d271eb444187 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:40.053468 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5d249-fa9e-4b4b-a630-d271eb444187 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:40.058166 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784ea-ea83-4429-9375-fcda5f5d44c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:40.058766 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784ea-ea83-4429-9375-fcda5f5d44c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.059049 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784ea-ea83-4429-9375-fcda5f5d44c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.059322 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382784ea-ea83-4429-9375-fcda5f5d44c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.059951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382784ea-ea83-4429-9375-fcda5f5d44c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:40.061866 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382784ea-ea83-4429-9375-fcda5f5d44c5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:40.088271 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1356/2721] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:39 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:19:40.092362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29e288-aa70-428a-9f92-712f127ef0c5 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:40.102940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29e288-aa70-428a-9f92-712f127ef0c5 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:40.160673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f5d9-ceda-4418-a9ab-f9ca7e44d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:40.161933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f5d9-ceda-4418-a9ab-f9ca7e44d775 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.162219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f5d9-ceda-4418-a9ab-f9ca7e44d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.162496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f5d9-ceda-4418-a9ab-f9ca7e44d775 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.163141 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f5d9-ceda-4418-a9ab-f9ca7e44d775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:40.165069 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f5d9-ceda-4418-a9ab-f9ca7e44d775 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:40.190765 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1366/2722] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:40 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:40.195382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784ea-ea83-4429-9375-fcda5f5d44c5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:40.206424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382784ea-ea83-4429-9375-fcda5f5d44c5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:40.211498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e381c2-1da1-4263-9c58-cf0ad8b0d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:40.212157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e381c2-1da1-4263-9c58-cf0ad8b0d8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.212463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e381c2-1da1-4263-9c58-cf0ad8b0d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.212734 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e381c2-1da1-4263-9c58-cf0ad8b0d8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.213373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e381c2-1da1-4263-9c58-cf0ad8b0d8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:40.215082 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e381c2-1da1-4263-9c58-cf0ad8b0d8e9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:40.358599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1357/2723] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:19:40.363172 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f5d9-ceda-4418-a9ab-f9ca7e44d775 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:40.373287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f5d9-ceda-4418-a9ab-f9ca7e44d775 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:40.378247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e145936-6e80-4ba9-b0df-b981980facd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:40.378917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e145936-6e80-4ba9-b0df-b981980facd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.379196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e145936-6e80-4ba9-b0df-b981980facd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.379959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e145936-6e80-4ba9-b0df-b981980facd0 admin admin] PATH_INFO: `/v3/projects/cd0329bdc72a495b95028fe06c424a88/users/8b5db870b9794fe99ea83f96a82dab9c/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.394321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e145936-6e80-4ba9-b0df-b981980facd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0329bdc72a495b95028fe06c424a88, user_id=8b5db870b9794fe99ea83f96a82dab9c, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:40.397640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e145936-6e80-4ba9-b0df-b981980facd0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:40.410636 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1367/2724] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:40 2022] PUT /identity/v3/projects/cd0329bdc72a495b95028fe06c424a88/users/8b5db870b9794fe99ea83f96a82dab9c/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:40.414780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e381c2-1da1-4263-9c58-cf0ad8b0d8e9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:40.425970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e381c2-1da1-4263-9c58-cf0ad8b0d8e9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:40.502804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513f7ba-1211-4004-8760-59df3cf6f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:40.503423 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513f7ba-1211-4004-8760-59df3cf6f761 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.503709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513f7ba-1211-4004-8760-59df3cf6f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.503978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513f7ba-1211-4004-8760-59df3cf6f761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.505143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513f7ba-1211-4004-8760-59df3cf6f761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:40.506793 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513f7ba-1211-4004-8760-59df3cf6f761 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:40.521023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1358/2725] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:40.522381 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e145936-6e80-4ba9-b0df-b981980facd0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:40.532956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e145936-6e80-4ba9-b0df-b981980facd0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:40.537715 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:40.538380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.538663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.538937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] PATH_INFO: `/v3/projects/cd0329bdc72a495b95028fe06c424a88/users/8b5db870b9794fe99ea83f96a82dab9c/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.540857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0329bdc72a495b95028fe06c424a88, user_id=8b5db870b9794fe99ea83f96a82dab9c, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:40.543635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:40.554759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1368/2726] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:40 2022] PUT /identity/v3/projects/cd0329bdc72a495b95028fe06c424a88/users/8b5db870b9794fe99ea83f96a82dab9c/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:40.565799 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431abf1-5cfd-4ec4-8543-66c34ea64f1d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.566106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431abf1-5cfd-4ec4-8543-66c34ea64f1d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.566884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431abf1-5cfd-4ec4-8543-66c34ea64f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.602265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d431abf1-5cfd-4ec4-8543-66c34ea64f1d None None] MFA Rules not processed for user `8b5db870b9794fe99ea83f96a82dab9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:40.604226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d431abf1-5cfd-4ec4-8543-66c34ea64f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:40.648895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:40.694187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1359/2727] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:40.706494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:40.708900 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:40.781645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a563b-040d-47dc-930e-257ff125ffc3 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:40.785517 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bee48-d890-46da-870d-76055d0e9c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:40.786255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bee48-d890-46da-870d-76055d0e9c75 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.786536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bee48-d890-46da-870d-76055d0e9c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.786812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bee48-d890-46da-870d-76055d0e9c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.796737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bee48-d890-46da-870d-76055d0e9c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:40.798205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bee48-d890-46da-870d-76055d0e9c75 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:40.808945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1369/2728] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:40.904752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431abf1-5cfd-4ec4-8543-66c34ea64f1d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:40.922210 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431abf1-5cfd-4ec4-8543-66c34ea64f1d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:40.926132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9d76b-4f96-4506-ad26-528abf4e7a0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:40.926784 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d76b-4f96-4506-ad26-528abf4e7a0d service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:40.927066 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d76b-4f96-4506-ad26-528abf4e7a0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:40.927330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d76b-4f96-4506-ad26-528abf4e7a0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:40.991456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9d76b-4f96-4506-ad26-528abf4e7a0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:40.993280 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9d76b-4f96-4506-ad26-528abf4e7a0d service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:41.007212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1360/2729] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:19:41.343147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bee48-d890-46da-870d-76055d0e9c75 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:41.367629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:41.417186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bee48-d890-46da-870d-76055d0e9c75 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:41.421777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:41.422409 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:41.422731 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:41.423131 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] PATH_INFO: `/v3/users/3e9e60346e8f434fbb188f51ef76e6c2` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:41.424421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9e60346e8f434fbb188f51ef76e6c2)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:41.426987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:41.488089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9e60346e8f434fbb188f51ef76e6c2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:41.500369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9e60346e8f434fbb188f51ef76e6c2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:41.508213 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9e60346e8f434fbb188f51ef76e6c2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:41.508843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9e60346e8f434fbb188f51ef76e6c2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:41.516485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9e60346e8f434fbb188f51ef76e6c2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:41.522456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1370/2730] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:41 2022] DELETE /identity/v3/users/3e9e60346e8f434fbb188f51ef76e6c2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:41.526887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2925f-0646-48cb-bde4-37d8d24dbf64 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:41.527310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2925f-0646-48cb-bde4-37d8d24dbf64 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:41.527422 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2925f-0646-48cb-bde4-37d8d24dbf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:41.545958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e8f2925f-0646-48cb-bde4-37d8d24dbf64 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:41.547145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e8f2925f-0646-48cb-bde4-37d8d24dbf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:41.610754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1361/2731] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:41.620886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:41.622331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:41.681268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119bda-195c-4310-98d1-07a7dac58800 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:41.684878 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390d46-c96f-4471-b463-8e785fc909eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:41.685518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390d46-c96f-4471-b463-8e785fc909eb service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:41.685799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390d46-c96f-4471-b463-8e785fc909eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:41.686072 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390d46-c96f-4471-b463-8e785fc909eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:41.694908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390d46-c96f-4471-b463-8e785fc909eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:41.696332 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390d46-c96f-4471-b463-8e785fc909eb service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:41.706104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1371/2732] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:41.979550 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2925f-0646-48cb-bde4-37d8d24dbf64 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:41.983273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e8f2925f-0646-48cb-bde4-37d8d24dbf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:41.999634 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2925f-0646-48cb-bde4-37d8d24dbf64 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:42.006661 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:42.007569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:42.007850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:42.008121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] PATH_INFO: `/v3/projects/346aa1aa094d4be0abd7336796683941` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:42.009254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346aa1aa094d4be0abd7336796683941)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:42.011259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:42.065136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346aa1aa094d4be0abd7336796683941', 'request_id': 'req-e6d2197d-04ed-4b32-b900-7f381379b220'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.074476 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346aa1aa094d4be0abd7336796683941', 'request_id': 'req-e6d2197d-04ed-4b32-b900-7f381379b220'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.082097 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346aa1aa094d4be0abd7336796683941', 'request_id': 'req-e6d2197d-04ed-4b32-b900-7f381379b220'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.085045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:42.096617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] The token cache is being invalidate because project 346aa1aa094d4be0abd7336796683941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:42.096985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.097712 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.099777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1362/2733] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:41 2022] DELETE /identity/v3/projects/346aa1aa094d4be0abd7336796683941 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:42.103865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390d46-c96f-4471-b463-8e785fc909eb service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:42.113337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390d46-c96f-4471-b463-8e785fc909eb service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:42.162503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:42.180425 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:42.181119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:42.181421 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:42.181834 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] PATH_INFO: `/v3/users/8b5db870b9794fe99ea83f96a82dab9c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:42.183397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5db870b9794fe99ea83f96a82dab9c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:42.185319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:42.232555 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5db870b9794fe99ea83f96a82dab9c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.245216 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5db870b9794fe99ea83f96a82dab9c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.253063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5db870b9794fe99ea83f96a82dab9c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.254054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5db870b9794fe99ea83f96a82dab9c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.261600 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-d979a478-854d-4785-96e7-c4f0dcdcf382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5db870b9794fe99ea83f96a82dab9c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.267983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1372/2734] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:42 2022] DELETE /identity/v3/users/8b5db870b9794fe99ea83f96a82dab9c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:42.566293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:42.568551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:42.583159 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2197d-04ed-4b32-b900-7f381379b220 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:42.673184 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:42.673869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:42.674171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:42.674451 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] PATH_INFO: `/v3/projects/cd0329bdc72a495b95028fe06c424a88` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:42.675689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0329bdc72a495b95028fe06c424a88)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:42.677871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:42.733781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0329bdc72a495b95028fe06c424a88', 'request_id': 'req-74536b83-ec1c-40f2-ae2b-adb727f82854'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.739257 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0329bdc72a495b95028fe06c424a88', 'request_id': 'req-74536b83-ec1c-40f2-ae2b-adb727f82854'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.745302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0329bdc72a495b95028fe06c424a88', 'request_id': 'req-74536b83-ec1c-40f2-ae2b-adb727f82854'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.758127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] The token cache is being invalidate because project cd0329bdc72a495b95028fe06c424a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:42.758485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.759099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-74536b83-ec1c-40f2-ae2b-adb727f82854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:42.760588 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1363/2735] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:42 2022] DELETE /identity/v3/projects/cd0329bdc72a495b95028fe06c424a88 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:42.765516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f504c31-8b1f-46b5-88ae-348b47b4ef57 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:42.765976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f504c31-8b1f-46b5-88ae-348b47b4ef57 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:42.766090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f504c31-8b1f-46b5-88ae-348b47b4ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:42.786199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5f504c31-8b1f-46b5-88ae-348b47b4ef57 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:42.787437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5f504c31-8b1f-46b5-88ae-348b47b4ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:42.852549 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1373/2736] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:42.915881 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c91a7-4f29-4919-9591-5851da9ea0a4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:42.916187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c91a7-4f29-4919-9591-5851da9ea0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:42.916483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c91a7-4f29-4919-9591-5851da9ea0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:42.936469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6f4c91a7-4f29-4919-9591-5851da9ea0a4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:42.937685 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6f4c91a7-4f29-4919-9591-5851da9ea0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:42.945893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1364/2737] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:42.950758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f504c31-8b1f-46b5-88ae-348b47b4ef57 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:42.963089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f504c31-8b1f-46b5-88ae-348b47b4ef57 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:42.970240 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:42.971045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:42.971391 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:42.971667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:42.972670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:42.972947 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:42.974728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:42.987349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1374/2738] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:42.992244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c91a7-4f29-4919-9591-5851da9ea0a4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:43.001802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c91a7-4f29-4919-9591-5851da9ea0a4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:43.006852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ecad5-1dab-4f6d-860e-0c03b898f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:43.007450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ecad5-1dab-4f6d-860e-0c03b898f61c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:43.007723 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ecad5-1dab-4f6d-860e-0c03b898f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:43.007988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ecad5-1dab-4f6d-860e-0c03b898f61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:43.008660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ecad5-1dab-4f6d-860e-0c03b898f61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:43.010530 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ecad5-1dab-4f6d-860e-0c03b898f61c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:43.039990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1365/2739] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:42 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:43.044383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:43.054737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84382bc4-9fa8-4243-880a-55ffe5e4c56c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:43.109728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:43.126946 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c92a20-57f5-4358-8b51-ab91bfe7711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:43.128180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92a20-57f5-4358-8b51-ab91bfe7711c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:43.128531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92a20-57f5-4358-8b51-ab91bfe7711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:43.129491 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92a20-57f5-4358-8b51-ab91bfe7711c admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:43.129687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c92a20-57f5-4358-8b51-ab91bfe7711c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:43.131785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c92a20-57f5-4358-8b51-ab91bfe7711c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:43.157299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1375/2740] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:43 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:43.161558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ecad5-1dab-4f6d-860e-0c03b898f61c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:43.173628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ecad5-1dab-4f6d-860e-0c03b898f61c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:43.181367 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf6861-b68f-463b-ba3a-b083a8858f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:43.182017 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf6861-b68f-463b-ba3a-b083a8858f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:43.182296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf6861-b68f-463b-ba3a-b083a8858f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:43.182563 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf6861-b68f-463b-ba3a-b083a8858f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:43.183207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf6861-b68f-463b-ba3a-b083a8858f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:43.184826 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf6861-b68f-463b-ba3a-b083a8858f5b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:43.196519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1366/2741] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:43.200481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c92a20-57f5-4358-8b51-ab91bfe7711c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:43.212074 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c92a20-57f5-4358-8b51-ab91bfe7711c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:43.217826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ba1d3-86e0-4777-898e-451bb8a607b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:43.218622 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba1d3-86e0-4777-898e-451bb8a607b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:43.218924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba1d3-86e0-4777-898e-451bb8a607b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:43.219212 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba1d3-86e0-4777-898e-451bb8a607b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:43.219950 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ba1d3-86e0-4777-898e-451bb8a607b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:43.221777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ba1d3-86e0-4777-898e-451bb8a607b7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:43.236102 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1376/2742] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:19:43.241485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf6861-b68f-463b-ba3a-b083a8858f5b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:43.251302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf6861-b68f-463b-ba3a-b083a8858f5b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:43.257102 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:43.257865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:43.258140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:43.258412 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] PATH_INFO: `/v3/projects/ac875d5a49d740498d0706669c0242b0/users/e0d595bbe6b54184a00fb34efeba40da/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:43.278930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac875d5a49d740498d0706669c0242b0, user_id=e0d595bbe6b54184a00fb34efeba40da, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:43.282114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:43.294939 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1367/2743] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:43 2022] PUT /identity/v3/projects/ac875d5a49d740498d0706669c0242b0/users/e0d595bbe6b54184a00fb34efeba40da/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:43.305760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700556-77da-4d6c-8f69-918a4f3deac3 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:43.306048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700556-77da-4d6c-8f69-918a4f3deac3 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:43.306323 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e700556-77da-4d6c-8f69-918a4f3deac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:43.342829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-0e700556-77da-4d6c-8f69-918a4f3deac3 None None] MFA Rules not processed for user `e0d595bbe6b54184a00fb34efeba40da`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:43.344053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0e700556-77da-4d6c-8f69-918a4f3deac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:43.416502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1377/2744] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:43.432259 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:43.434111 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:43.458578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:43.499217 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cdcad-75dd-4e1c-a092-7dca1ff2b7ac admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:43.503433 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d637726e3142e6ba90fa201c764b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:43.504298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:43.505395 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:43.506035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:43.516636 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:43.518140 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:43.527727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1368/2745] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:43.927693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700556-77da-4d6c-8f69-918a4f3deac3 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:43.929111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-0e700556-77da-4d6c-8f69-918a4f3deac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:44.049503 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e700556-77da-4d6c-8f69-918a4f3deac3 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:44.058662 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:44.059507 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:44.060202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:44.060430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:44.063560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:44.081198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:44.083370 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:44.100037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1378/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:47.991587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:47.992991 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:48.049377 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb4f06-1258-4a71-805c-ec8ace014fd3 service glance] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:48.053002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:48.053627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:48.053906 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:48.054177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:48.055930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:48.120572 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:48.122425 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:48.134863 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1369/2747] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:51.378706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:51.380314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:51.432207 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:51.444543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:51.446121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:51.459602 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3a71-2738-4b5f-952b-7f0181766b5d service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:51.467415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453cda7-7cb2-49c5-9a66-753f1554fabb service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:51.469070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:51.469730 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:51.470013 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:51.470285 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] PATH_INFO: `/v3/users/b657cf5dbf394b9db923082f00565a3a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:51.471402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b657cf5dbf394b9db923082f00565a3a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:51.472544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:51.473902 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:51.474056 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:51.474181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:51.474475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:51.476255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:51.488948 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:51.490602 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:51.501745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1379/2748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:51.542710 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b657cf5dbf394b9db923082f00565a3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.552790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b657cf5dbf394b9db923082f00565a3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.563713 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:51.565926 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b657cf5dbf394b9db923082f00565a3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.566570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b657cf5dbf394b9db923082f00565a3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.576624 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f1af1b37-96c4-4e50-a636-70ac162d848a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b657cf5dbf394b9db923082f00565a3a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.584349 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1370/2749] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:19:51 2022] DELETE /identity/v3/users/b657cf5dbf394b9db923082f00565a3a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:51.765338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:51.777603 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f4e1f-05b3-4a4a-88a5-8567dbf3c53b service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:51.836982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:51.837644 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:51.837930 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:51.838202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] PATH_INFO: `/v3/projects/91d70034e6ca4457b458ac51eba10005` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:51.839311 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d70034e6ca4457b458ac51eba10005)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:51.841205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:51.887197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d70034e6ca4457b458ac51eba10005', 'request_id': 'req-9b3b7d2e-da08-4288-8091-06bc139b2041'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.893862 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d70034e6ca4457b458ac51eba10005', 'request_id': 'req-9b3b7d2e-da08-4288-8091-06bc139b2041'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.900219 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d70034e6ca4457b458ac51eba10005', 'request_id': 'req-9b3b7d2e-da08-4288-8091-06bc139b2041'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.911089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] The token cache is being invalidate because project 91d70034e6ca4457b458ac51eba10005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:19:51.911376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.912014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9b3b7d2e-da08-4288-8091-06bc139b2041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:19:51.913513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1380/2750] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:19:51 2022] DELETE /identity/v3/projects/91d70034e6ca4457b458ac51eba10005 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:19:51.918509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690f2e-9b5e-4a85-9150-86c52161ae6a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:51.918871 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690f2e-9b5e-4a85-9150-86c52161ae6a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:51.919220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690f2e-9b5e-4a85-9150-86c52161ae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:51.939120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5c690f2e-9b5e-4a85-9150-86c52161ae6a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:51.940363 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5c690f2e-9b5e-4a85-9150-86c52161ae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:52.006192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1371/2751] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:52.013956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61038db-c4b4-4180-8dde-e3b897127b2e None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.014248 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61038db-c4b4-4180-8dde-e3b897127b2e None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.014525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61038db-c4b4-4180-8dde-e3b897127b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.034453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b61038db-c4b4-4180-8dde-e3b897127b2e None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:52.036315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b61038db-c4b4-4180-8dde-e3b897127b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:52.044198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1381/2752] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:52.048276 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c690f2e-9b5e-4a85-9150-86c52161ae6a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:52.058823 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c690f2e-9b5e-4a85-9150-86c52161ae6a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:52.064307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:52.065036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.065531 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.065897 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.066705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:19:52.067108 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:52.069269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:52.082983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1372/2753] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:19:52.087374 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61038db-c4b4-4180-8dde-e3b897127b2e None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:52.096704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61038db-c4b4-4180-8dde-e3b897127b2e None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:52.101380 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63c7e-d95f-4aba-9322-7495c8e9b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:52.102008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63c7e-d95f-4aba-9322-7495c8e9b21c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.102291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63c7e-d95f-4aba-9322-7495c8e9b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.102566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63c7e-d95f-4aba-9322-7495c8e9b21c admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.103205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe63c7e-d95f-4aba-9322-7495c8e9b21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:52.105096 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe63c7e-d95f-4aba-9322-7495c8e9b21c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:52.133253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1382/2754] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:19:52 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:52.137266 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:52.147467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3deb6e-611f-46e9-852d-42f7429f30e3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:52.208194 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ddd9f-23be-47c1-a52d-04ab51001005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:52.208716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ddd9f-23be-47c1-a52d-04ab51001005 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.208996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ddd9f-23be-47c1-a52d-04ab51001005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.209798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ddd9f-23be-47c1-a52d-04ab51001005 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.210445 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ddd9f-23be-47c1-a52d-04ab51001005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:52.212439 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ddd9f-23be-47c1-a52d-04ab51001005 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:52.235651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1373/2755] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:19:52 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:19:52.239648 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63c7e-d95f-4aba-9322-7495c8e9b21c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:52.249904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63c7e-d95f-4aba-9322-7495c8e9b21c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:52.254763 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2252a4e-d480-497a-a4a2-be681f0fcb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:52.255353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2252a4e-d480-497a-a4a2-be681f0fcb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.255630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2252a4e-d480-497a-a4a2-be681f0fcb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.255903 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2252a4e-d480-497a-a4a2-be681f0fcb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.256541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2252a4e-d480-497a-a4a2-be681f0fcb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:52.258177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2252a4e-d480-497a-a4a2-be681f0fcb5d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:52.268074 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1383/2756] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:52.272430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ddd9f-23be-47c1-a52d-04ab51001005 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:52.282156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ddd9f-23be-47c1-a52d-04ab51001005 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:52.287365 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d2bfd-fcc9-4d5e-ad59-e541d93e0f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:52.287944 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2bfd-fcc9-4d5e-ad59-e541d93e0f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.288219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2bfd-fcc9-4d5e-ad59-e541d93e0f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.288487 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2bfd-fcc9-4d5e-ad59-e541d93e0f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.289116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2bfd-fcc9-4d5e-ad59-e541d93e0f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:52.290729 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2bfd-fcc9-4d5e-ad59-e541d93e0f5c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:52.301497 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1374/2757] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:19:52.305673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2252a4e-d480-497a-a4a2-be681f0fcb5d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:52.315558 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2252a4e-d480-497a-a4a2-be681f0fcb5d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:52.320754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:52.321424 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.321709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.321987 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] PATH_INFO: `/v3/projects/8c148033e187419da15f2552cfaa8516/users/40fc3f905b564f37b36b5e15d60f07a6/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.336437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c148033e187419da15f2552cfaa8516, user_id=40fc3f905b564f37b36b5e15d60f07a6, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:52.339265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:52.346754 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:52.353220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1384/2758] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:19:52 2022] PUT /identity/v3/projects/8c148033e187419da15f2552cfaa8516/users/40fc3f905b564f37b36b5e15d60f07a6/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:19:52.358045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9d8c-0e23-4382-ae8f-54445df87f59 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.358330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9d8c-0e23-4382-ae8f-54445df87f59 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.358601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9d8c-0e23-4382-ae8f-54445df87f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.378310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-60ef9d8c-0e23-4382-ae8f-54445df87f59 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:52.379557 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-60ef9d8c-0e23-4382-ae8f-54445df87f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:52.425705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:52.444223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1375/2759] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:52.454685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:52.456727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:52.523631 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654459-9ff3-4374-adcb-cb77b4e470e7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:52.526274 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca8a1a-bc9a-408b-8238-89804887c719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:52.526953 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca8a1a-bc9a-408b-8238-89804887c719 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:52.527259 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca8a1a-bc9a-408b-8238-89804887c719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:52.527530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca8a1a-bc9a-408b-8238-89804887c719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:52.538158 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca8a1a-bc9a-408b-8238-89804887c719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:52.539594 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca8a1a-bc9a-408b-8238-89804887c719 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:52.549117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1385/2760] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:54.218299 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef9d8c-0e23-4382-ae8f-54445df87f59 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:54.219935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-60ef9d8c-0e23-4382-ae8f-54445df87f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:54.238381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef9d8c-0e23-4382-ae8f-54445df87f59 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:54.242473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:54.243200 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:54.243456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:54.243716 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:54.245637 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:54.259774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:54.261232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:54.277751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1376/2761] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:57.296309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25346e6-2f05-44e1-9ce3-a876190cb673 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:57.296870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25346e6-2f05-44e1-9ce3-a876190cb673 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:57.296870 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25346e6-2f05-44e1-9ce3-a876190cb673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:57.329483 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-a25346e6-2f05-44e1-9ce3-a876190cb673 None None] MFA Rules not processed for user `40fc3f905b564f37b36b5e15d60f07a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:57.330816 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a25346e6-2f05-44e1-9ce3-a876190cb673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:57.417571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1386/2762] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:19:57.432484 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:19:57.434067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:57.626568 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09702d7d-2713-4000-b7eb-f5841ff66911 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:19:57.634627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:19:57.635269 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:57.635555 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:57.635958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:57.645902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:19:57.647904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:19:57.663470 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1377/2763] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:19:59.522109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8a457-2172-4c5b-9951-17b57ff9b276 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:19:59.522660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8a457-2172-4c5b-9951-17b57ff9b276 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:19:59.523463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8a457-2172-4c5b-9951-17b57ff9b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:19:59.544127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-86e8a457-2172-4c5b-9951-17b57ff9b276 None None] MFA Rules not processed for user `40fc3f905b564f37b36b5e15d60f07a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:19:59.547518 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-86e8a457-2172-4c5b-9951-17b57ff9b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:19:59.557536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1387/2764] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:20:01.647163 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:01.649207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:01.664934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e93be-9586-49dd-9c18-845ce0a5ee25 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:01.669316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:01.669974 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:01.670250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:01.670520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] PATH_INFO: `/v3/users/e0d595bbe6b54184a00fb34efeba40da` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:01.671656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d595bbe6b54184a00fb34efeba40da)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:01.673628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:01.729347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d595bbe6b54184a00fb34efeba40da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:01.737938 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d595bbe6b54184a00fb34efeba40da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:01.751212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d595bbe6b54184a00fb34efeba40da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:01.751846 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d595bbe6b54184a00fb34efeba40da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:01.759770 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d595bbe6b54184a00fb34efeba40da'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:01.765595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1378/2765] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:20:01 2022] DELETE /identity/v3/users/e0d595bbe6b54184a00fb34efeba40da => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:20:01.770264 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed422-d072-48e8-b85a-9678035a3634 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:01.770749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed422-d072-48e8-b85a-9678035a3634 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:01.770852 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ed422-d072-48e8-b85a-9678035a3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:01.789846 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-6a0ed422-d072-48e8-b85a-9678035a3634 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:20:01.791062 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6a0ed422-d072-48e8-b85a-9678035a3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:01.852376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1388/2766] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:20:01.862171 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:01.864099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:01.906748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:01.927414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f4f5a-ead0-4ae4-9fe5-96bef11b450f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:01.931477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768815-374d-42b7-915d-4ebe30bf8ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:01.932112 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768815-374d-42b7-915d-4ebe30bf8ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:01.932435 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768815-374d-42b7-915d-4ebe30bf8ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:01.932709 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768815-374d-42b7-915d-4ebe30bf8ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:01.943769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61768815-374d-42b7-915d-4ebe30bf8ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:01.945296 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61768815-374d-42b7-915d-4ebe30bf8ebc service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:01.955676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1379/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:20:02.440550 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ed422-d072-48e8-b85a-9678035a3634 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:02.442977 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-6a0ed422-d072-48e8-b85a-9678035a3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:02.457440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ed422-d072-48e8-b85a-9678035a3634 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:02.480067 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:02.481260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:02.481444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:02.481727 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] PATH_INFO: `/v3/projects/ac875d5a49d740498d0706669c0242b0` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:02.486012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac875d5a49d740498d0706669c0242b0)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:02.488898 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:02.561041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:02.594497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac875d5a49d740498d0706669c0242b0', 'request_id': 'req-604202aa-5bad-4296-8443-a50a4d4dd5d2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:02.612855 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac875d5a49d740498d0706669c0242b0', 'request_id': 'req-604202aa-5bad-4296-8443-a50a4d4dd5d2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:02.624140 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac875d5a49d740498d0706669c0242b0', 'request_id': 'req-604202aa-5bad-4296-8443-a50a4d4dd5d2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:02.638767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] The token cache is being invalidate because project ac875d5a49d740498d0706669c0242b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:20:02.639728 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:02.639858 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-604202aa-5bad-4296-8443-a50a4d4dd5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:02.645501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1389/2768] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:20:02 2022] DELETE /identity/v3/projects/ac875d5a49d740498d0706669c0242b0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:20:02.646821 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d013c-966b-44ca-9bae-162ffa223bbe None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:02.647132 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d013c-966b-44ca-9bae-162ffa223bbe None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:02.647414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d013c-966b-44ca-9bae-162ffa223bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:02.676566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-147d013c-966b-44ca-9bae-162ffa223bbe None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:20:02.678818 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-147d013c-966b-44ca-9bae-162ffa223bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:02.769596 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1380/2769] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:20:02.776372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5afa-c546-41f3-a1ab-5855eeff196b None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:02.776917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5afa-c546-41f3-a1ab-5855eeff196b None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:02.776917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf5afa-c546-41f3-a1ab-5855eeff196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:02.820522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-5faf5afa-c546-41f3-a1ab-5855eeff196b None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:20:02.822270 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5faf5afa-c546-41f3-a1ab-5855eeff196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:02.833534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1390/2770] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:20:02.838006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d013c-966b-44ca-9bae-162ffa223bbe None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:02.852920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d013c-966b-44ca-9bae-162ffa223bbe None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:02.857949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:02.859206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:02.860012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:02.860338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:02.861145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:20:02.862304 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:02.865119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:02.882318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1381/2771] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:20:02.883618 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf5afa-c546-41f3-a1ab-5855eeff196b None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:02.896251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf5afa-c546-41f3-a1ab-5855eeff196b None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:02.902884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3014e-3a7d-4d1b-9bb3-993e7b3e75a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:02.903553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3014e-3a7d-4d1b-9bb3-993e7b3e75a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:02.904014 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3014e-3a7d-4d1b-9bb3-993e7b3e75a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:02.904446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3014e-3a7d-4d1b-9bb3-993e7b3e75a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:02.905293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3014e-3a7d-4d1b-9bb3-993e7b3e75a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:02.908376 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3014e-3a7d-4d1b-9bb3-993e7b3e75a0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:02.946211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1391/2772] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:20:02 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:20:02.947472 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:02.957930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38510f-a6db-477b-a0e2-cf7089d79e09 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:03.024016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e757e-ff94-4dc4-904c-bef9a5353c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:03.024632 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e757e-ff94-4dc4-904c-bef9a5353c4a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:03.024914 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e757e-ff94-4dc4-904c-bef9a5353c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:03.025190 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e757e-ff94-4dc4-904c-bef9a5353c4a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:03.025856 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e757e-ff94-4dc4-904c-bef9a5353c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:03.027978 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e757e-ff94-4dc4-904c-bef9a5353c4a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:03.049653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1382/2773] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:20:02 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:20:03.054545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3014e-3a7d-4d1b-9bb3-993e7b3e75a0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:03.065336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3014e-3a7d-4d1b-9bb3-993e7b3e75a0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:03.070168 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb8ea-2419-400d-b222-d719817a6468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:03.070799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb8ea-2419-400d-b222-d719817a6468 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:03.071082 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb8ea-2419-400d-b222-d719817a6468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:03.071355 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb8ea-2419-400d-b222-d719817a6468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:03.072006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bb8ea-2419-400d-b222-d719817a6468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:03.073646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bb8ea-2419-400d-b222-d719817a6468 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:03.084471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1392/2774] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 01:20:03.088522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e757e-ff94-4dc4-904c-bef9a5353c4a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:03.101744 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e757e-ff94-4dc4-904c-bef9a5353c4a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:03.106892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556160a-e863-439e-bd42-c0f9e3f44853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:03.107520 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556160a-e863-439e-bd42-c0f9e3f44853 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:03.107790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556160a-e863-439e-bd42-c0f9e3f44853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:03.108063 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556160a-e863-439e-bd42-c0f9e3f44853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:03.108708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556160a-e863-439e-bd42-c0f9e3f44853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:03.110382 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556160a-e863-439e-bd42-c0f9e3f44853 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:03.122145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1383/2775] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:20:03.126288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb8ea-2419-400d-b222-d719817a6468 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:03.139745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb8ea-2419-400d-b222-d719817a6468 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:03.144918 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:03.145831 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:03.146220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:03.146500 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] PATH_INFO: `/v3/projects/9a96acfceb6f4842897978ab2329a514/users/ba95a9eb563e4efa9cfa69dbd4a6f0b9/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:03.162237 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a96acfceb6f4842897978ab2329a514, user_id=ba95a9eb563e4efa9cfa69dbd4a6f0b9, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:03.164937 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:03.184582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1393/2776] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:20:03 2022] PUT /identity/v3/projects/9a96acfceb6f4842897978ab2329a514/users/ba95a9eb563e4efa9cfa69dbd4a6f0b9/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:20:03.195320 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be5c5-eaaf-4178-99e0-3cd636b2847c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:03.195674 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be5c5-eaaf-4178-99e0-3cd636b2847c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:03.195949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7be5c5-eaaf-4178-99e0-3cd636b2847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:03.225950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ec7be5c5-eaaf-4178-99e0-3cd636b2847c None None] MFA Rules not processed for user `ba95a9eb563e4efa9cfa69dbd4a6f0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:20:03.226913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ec7be5c5-eaaf-4178-99e0-3cd636b2847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:03.264223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:03.300254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1384/2777] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:20:03.312383 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:03.314314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:03.383313 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8a3da-6403-48f0-a0bf-05c00ce8a4f7 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:03.387295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34505f7-8a0d-4889-bc19-0b4f1da86772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:03.387917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34505f7-8a0d-4889-bc19-0b4f1da86772 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:03.388200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34505f7-8a0d-4889-bc19-0b4f1da86772 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:03.388475 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34505f7-8a0d-4889-bc19-0b4f1da86772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:03.399670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34505f7-8a0d-4889-bc19-0b4f1da86772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:03.401133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34505f7-8a0d-4889-bc19-0b4f1da86772 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:03.413293 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1394/2778] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:20:04.743181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7be5c5-eaaf-4178-99e0-3cd636b2847c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:04.745292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ec7be5c5-eaaf-4178-99e0-3cd636b2847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:04.858052 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7be5c5-eaaf-4178-99e0-3cd636b2847c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:04.864603 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde7850-1f1d-432f-a3ca-69a213ae7b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:04.865344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7850-1f1d-432f-a3ca-69a213ae7b5d service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:04.865933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7850-1f1d-432f-a3ca-69a213ae7b5d service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:04.866168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7850-1f1d-432f-a3ca-69a213ae7b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:04.867944 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-abde7850-1f1d-432f-a3ca-69a213ae7b5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:04.881708 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde7850-1f1d-432f-a3ca-69a213ae7b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:04.883307 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde7850-1f1d-432f-a3ca-69a213ae7b5d service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:04.896119 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1385/2779] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:20:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:20:06.073422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34505f7-8a0d-4889-bc19-0b4f1da86772 service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:06.129830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:06.146737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34505f7-8a0d-4889-bc19-0b4f1da86772 service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:06.151315 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:06.151951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:06.152236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:06.152511 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] PATH_INFO: `/v3/users/ba95a9eb563e4efa9cfa69dbd4a6f0b9` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:06.153677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba95a9eb563e4efa9cfa69dbd4a6f0b9)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:06.155616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:06.202954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba95a9eb563e4efa9cfa69dbd4a6f0b9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.215519 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba95a9eb563e4efa9cfa69dbd4a6f0b9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.223849 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba95a9eb563e4efa9cfa69dbd4a6f0b9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.224482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba95a9eb563e4efa9cfa69dbd4a6f0b9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.231674 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba95a9eb563e4efa9cfa69dbd4a6f0b9'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.237749 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1395/2780] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:20:06 2022] DELETE /identity/v3/users/ba95a9eb563e4efa9cfa69dbd4a6f0b9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:20:06.242339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ec19-c466-4312-9eda-dea77fcc428a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:06.242820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ec19-c466-4312-9eda-dea77fcc428a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:06.242932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ec19-c466-4312-9eda-dea77fcc428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:06.264156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-02a8ec19-c466-4312-9eda-dea77fcc428a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:20:06.265372 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-02a8ec19-c466-4312-9eda-dea77fcc428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:06.323742 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1386/2781] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:20:06.333978 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:06.335444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:06.395833 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580331fa-8ba2-49e4-98f3-f5d7fbb2657e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:06.401352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:06.402011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:06.402298 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:06.402576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:06.414198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:06.415939 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:06.428657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1396/2782] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:20:06.805053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ec19-c466-4312-9eda-dea77fcc428a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:06.806532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-02a8ec19-c466-4312-9eda-dea77fcc428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:06.820970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ec19-c466-4312-9eda-dea77fcc428a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:06.827146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:06.828295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:06.828717 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:06.829089 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] PATH_INFO: `/v3/projects/9a96acfceb6f4842897978ab2329a514` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:06.830740 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a96acfceb6f4842897978ab2329a514)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:06.833374 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:06.894864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a96acfceb6f4842897978ab2329a514', 'request_id': 'req-05677853-0ec6-4eac-90d0-575357b3a798'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.899653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:06.902225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a96acfceb6f4842897978ab2329a514', 'request_id': 'req-05677853-0ec6-4eac-90d0-575357b3a798'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.910540 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a96acfceb6f4842897978ab2329a514', 'request_id': 'req-05677853-0ec6-4eac-90d0-575357b3a798'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.924004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] The token cache is being invalidate because project 9a96acfceb6f4842897978ab2329a514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:20:06.924386 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.925015 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:20:06.927092 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1387/2783] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:20:06 2022] DELETE /identity/v3/projects/9a96acfceb6f4842897978ab2329a514 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:20:07.543530 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:07.544933 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:07.556882 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc869fb-50e2-4ebf-8d25-0f7f8c24fa41 service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:07.605362 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791f829-f120-4614-8f3f-472a3a2319c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:07.606008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791f829-f120-4614-8f3f-472a3a2319c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:07.606288 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791f829-f120-4614-8f3f-472a3a2319c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:07.606559 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791f829-f120-4614-8f3f-472a3a2319c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:07.608342 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9791f829-f120-4614-8f3f-472a3a2319c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:07.632177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:07.678074 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791f829-f120-4614-8f3f-472a3a2319c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:07.679515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791f829-f120-4614-8f3f-472a3a2319c3 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:07.689123 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1397/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:20:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:20:09.250448 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:09.252027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:09.327325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05677853-0ec6-4eac-90d0-575357b3a798 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:09.333262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:09.333904 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:09.334192 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:09.334466 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:09.336199 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:09.349262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:09.350930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:09.361676 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1388/2785] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:20:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:20:17.684745 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=19 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:19.357155 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=2,keystone:SELECT=39,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:52.443280 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fae8-e000-4eb9-b63f-57c1acfff395 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:52.443824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fae8-e000-4eb9-b63f-57c1acfff395 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:52.443824 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fae8-e000-4eb9-b63f-57c1acfff395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:52.463371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-7720fae8-e000-4eb9-b63f-57c1acfff395 None None] MFA Rules not processed for user `40fc3f905b564f37b36b5e15d60f07a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:20:52.464499 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7720fae8-e000-4eb9-b63f-57c1acfff395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:52.520880 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1398/2786] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:20:52.825325 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:20:52.826798 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:52.838317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323439a-8fae-4b3f-8e36-a8e3c54ee4b9 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:20:52.841943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:20:52.842534 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:20:52.842816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:20:52.843088 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:20:52.844724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:20:52.854287 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:20:52.855765 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:20:52.864216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1389/2787] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:21:02.513868 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=25 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:02.860128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:49.845035 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1b67-96e2-4570-9097-fb0babb25fe0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:21:49.845585 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1b67-96e2-4570-9097-fb0babb25fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:21:49.845693 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1b67-96e2-4570-9097-fb0babb25fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:21:49.874192 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8ecc1b67-96e2-4570-9097-fb0babb25fe0 None None] MFA Rules not processed for user `40fc3f905b564f37b36b5e15d60f07a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:21:49.875413 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8ecc1b67-96e2-4570-9097-fb0babb25fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:21:49.898845 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1399/2788] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:21:59.897080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=15 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:22:18.433892 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:22:18.435316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:22:18.559571 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52050f89-942b-4793-91e4-87f880284580 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:22:18.564651 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826051a-e35f-49d4-9ab5-ad306dd84e5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:22:18.565279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826051a-e35f-49d4-9ab5-ad306dd84e5f service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:22:18.565594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826051a-e35f-49d4-9ab5-ad306dd84e5f service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:22:18.565869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826051a-e35f-49d4-9ab5-ad306dd84e5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:22:18.567577 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8826051a-e35f-49d4-9ab5-ad306dd84e5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:22:18.578829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826051a-e35f-49d4-9ab5-ad306dd84e5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:22:18.580388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826051a-e35f-49d4-9ab5-ad306dd84e5f service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:22:18.590133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1390/2789] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:22:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:22:19.155509 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc1b67-96e2-4570-9097-fb0babb25fe0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:22:19.175811 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc1b67-96e2-4570-9097-fb0babb25fe0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:22:19.179482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891ae6-3f73-4d50-9fcb-d70de8b7dbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:22:19.180089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891ae6-3f73-4d50-9fcb-d70de8b7dbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:22:19.180487 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891ae6-3f73-4d50-9fcb-d70de8b7dbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:22:19.180768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891ae6-3f73-4d50-9fcb-d70de8b7dbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:22:19.182582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f7891ae6-3f73-4d50-9fcb-d70de8b7dbe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:22:19.208884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891ae6-3f73-4d50-9fcb-d70de8b7dbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:22:19.211039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891ae6-3f73-4d50-9fcb-d70de8b7dbe3 service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:22:19.219317 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1400/2790] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:22:19.319040 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bff983-0cde-4541-bdb3-d86011b22a3c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:22:19.319424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bff983-0cde-4541-bdb3-d86011b22a3c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:22:19.319816 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bff983-0cde-4541-bdb3-d86011b22a3c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:22:19.321327 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1391/2791] 10.222.0.20 () {54 vars in 921 bytes} [Thu Sep 8 01:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 01:22:19.330273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7fa8-6f85-4290-a87e-5725d3bebe70 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:22:19.330562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7fa8-6f85-4290-a87e-5725d3bebe70 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:22:19.330839 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7fa8-6f85-4290-a87e-5725d3bebe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:22:19.382453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-715d7fa8-6f85-4290-a87e-5725d3bebe70 None None] MFA Rules not processed for user `1b9f7c644bde4c94a8cfe5ec13e782c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:22:19.383767 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-715d7fa8-6f85-4290-a87e-5725d3bebe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:22:19.409335 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1401/2792] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Sep 8 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:22:19.419902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bff983-0cde-4541-bdb3-d86011b22a3c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:22:19.430912 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bff983-0cde-4541-bdb3-d86011b22a3c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:22:19.434462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:22:19.435098 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:22:19.435324 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:22:19.435597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:22:19.446359 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:22:19.447773 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:22:19.458352 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1392/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:22:29.406469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=38 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:22:29.453660 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=63 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:22:48.967926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eaf99-7bc9-4ee0-8aa4-ba036c935198 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:22:48.968448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eaf99-7bc9-4ee0-8aa4-ba036c935198 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:22:48.968569 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eaf99-7bc9-4ee0-8aa4-ba036c935198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:22:48.989545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-064eaf99-7bc9-4ee0-8aa4-ba036c935198 None None] MFA Rules not processed for user `40fc3f905b564f37b36b5e15d60f07a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:22:48.990761 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-064eaf99-7bc9-4ee0-8aa4-ba036c935198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:22:48.998353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1402/2794] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:22:58.984206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:37.782956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:37.784436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:37.879074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c283c-ffce-4bf9-9590-67115a302ad5 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:37.882824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:37.883462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:37.883736 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:37.884009 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:37.885907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:37.900893 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:37.902558 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:37.914719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1393/2795] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:23:39.628388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eaf99-7bc9-4ee0-8aa4-ba036c935198 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:39.638181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eaf99-7bc9-4ee0-8aa4-ba036c935198 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:39.641742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:39.642334 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:39.642612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:39.642884 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:39.644572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:39.657723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:39.659138 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:39.669809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1403/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:23:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:23:47.909566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=35 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:49.665127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=6 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:50.631087 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:50.645506 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc698d-b99d-4bd5-9538-fc2b75a8d79a service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:50.652019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:50.652679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:50.653181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:50.653690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:50.655561 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:50.673121 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:50.675741 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:50.688985 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1394/2797] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:23:50.689521 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:50.692430 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:50.809011 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67392d-ea3c-4fdf-ba12-1911f4c60fcb service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:50.813778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:50.814404 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:50.814692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:50.814968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] PATH_INFO: `/v3/users/c377afe8e83944c3887614b4c858337c` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:50.816109 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c377afe8e83944c3887614b4c858337c)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:50.818068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:50.865025 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c377afe8e83944c3887614b4c858337c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:50.876926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c377afe8e83944c3887614b4c858337c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:50.884305 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c377afe8e83944c3887614b4c858337c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:50.884928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c377afe8e83944c3887614b4c858337c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:50.892452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c377afe8e83944c3887614b4c858337c'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:50.898516 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1404/2798] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:23:50 2022] DELETE /identity/v3/users/c377afe8e83944c3887614b4c858337c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:51.068824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:51.082195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c4cb0-22bb-4d25-9868-c60eada01822 service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:51.167927 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:51.168339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:51.168613 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:51.168880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] PATH_INFO: `/v3/projects/7a933c142e1f48d6be283289eca5940a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:51.171865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a933c142e1f48d6be283289eca5940a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:51.171865 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:51.229221 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a933c142e1f48d6be283289eca5940a', 'request_id': 'req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.235146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a933c142e1f48d6be283289eca5940a', 'request_id': 'req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.241867 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a933c142e1f48d6be283289eca5940a', 'request_id': 'req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.255972 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] The token cache is being invalidate because project 7a933c142e1f48d6be283289eca5940a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:23:51.256261 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.256880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.258389 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1395/2799] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:23:51 2022] DELETE /identity/v3/projects/7a933c142e1f48d6be283289eca5940a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:51.262412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:51.263940 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:51.279369 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e5c76-dbe7-4959-86f0-61e685d4e08e admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:51.328390 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:51.340473 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:51.341119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:51.341392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:51.341694 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] PATH_INFO: `/v3/users/049f091bc2b94f5991cf8a5275986623` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:51.342838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] RBAC: Authorizing `identity:delete_user(user_id=049f091bc2b94f5991cf8a5275986623)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:51.344777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:51.393872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049f091bc2b94f5991cf8a5275986623'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.406864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049f091bc2b94f5991cf8a5275986623'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.413612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049f091bc2b94f5991cf8a5275986623'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.414226 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049f091bc2b94f5991cf8a5275986623'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.421314 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049f091bc2b94f5991cf8a5275986623'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.427431 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1405/2800] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:23:51 2022] DELETE /identity/v3/users/049f091bc2b94f5991cf8a5275986623 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:51.610438 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:51.612012 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:51.626954 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f866a0-4c2d-48a0-be7c-2001e8c5c2de admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:51.683986 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:51.684610 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:51.684801 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:51.685075 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] PATH_INFO: `/v3/projects/75a4d1288111443ab04fa3316ee91a9b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:51.686228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a4d1288111443ab04fa3316ee91a9b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:51.688728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:51.709019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:51.734417 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a4d1288111443ab04fa3316ee91a9b', 'request_id': 'req-1153f686-cc37-4b91-be3e-4e08de98081c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.740719 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a4d1288111443ab04fa3316ee91a9b', 'request_id': 'req-1153f686-cc37-4b91-be3e-4e08de98081c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.746781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a4d1288111443ab04fa3316ee91a9b', 'request_id': 'req-1153f686-cc37-4b91-be3e-4e08de98081c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.759629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] The token cache is being invalidate because project 75a4d1288111443ab04fa3316ee91a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:23:51.759913 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.760527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:51.762019 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1396/2801] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:23:51 2022] DELETE /identity/v3/projects/75a4d1288111443ab04fa3316ee91a9b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:55.415448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:55.417013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:55.435695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44373505-729b-489e-aca6-1ac0f9b4387b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:55.492689 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:55.493234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:55.493548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:55.493821 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] PATH_INFO: `/v3/users/40fc3f905b564f37b36b5e15d60f07a6` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:55.494926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fc3f905b564f37b36b5e15d60f07a6)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:55.496825 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:55.546704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fc3f905b564f37b36b5e15d60f07a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.559382 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fc3f905b564f37b36b5e15d60f07a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.566998 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fc3f905b564f37b36b5e15d60f07a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.567653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fc3f905b564f37b36b5e15d60f07a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.569312 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:55.580053 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1ce1da9a-a12c-43bc-b803-3dba739404aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fc3f905b564f37b36b5e15d60f07a6'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.587436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1406/2802] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:23:55 2022] DELETE /identity/v3/users/40fc3f905b564f37b36b5e15d60f07a6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:55.765599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:55.767844 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:55.781105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f686-cc37-4b91-be3e-4e08de98081c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:55.843114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:55.844569 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:55.844850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:55.845124 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] PATH_INFO: `/v3/projects/8c148033e187419da15f2552cfaa8516` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:55.846910 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c148033e187419da15f2552cfaa8516)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:55.849169 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:55.897604 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c148033e187419da15f2552cfaa8516', 'request_id': 'req-2f430378-c488-4802-bd8a-4e2acd61ff94'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.903239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c148033e187419da15f2552cfaa8516', 'request_id': 'req-2f430378-c488-4802-bd8a-4e2acd61ff94'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.909350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c148033e187419da15f2552cfaa8516', 'request_id': 'req-2f430378-c488-4802-bd8a-4e2acd61ff94'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.923652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] The token cache is being invalidate because project 8c148033e187419da15f2552cfaa8516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:23:55.923652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.923996 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2f430378-c488-4802-bd8a-4e2acd61ff94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:55.925193 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1397/2803] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:23:55 2022] DELETE /identity/v3/projects/8c148033e187419da15f2552cfaa8516 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:55.930177 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8a44-292e-4cf8-9378-3c363dace08c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:55.930471 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8a44-292e-4cf8-9378-3c363dace08c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:55.930737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8a44-292e-4cf8-9378-3c363dace08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:55.978785 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-b97b8a44-292e-4cf8-9378-3c363dace08c None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:55.979989 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b97b8a44-292e-4cf8-9378-3c363dace08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:56.038289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1407/2804] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:56.045994 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b813b-0515-4490-9f98-8f9b3fe1e087 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.046279 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b813b-0515-4490-9f98-8f9b3fe1e087 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.046551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b813b-0515-4490-9f98-8f9b3fe1e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.066839 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-de9b813b-0515-4490-9f98-8f9b3fe1e087 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:56.068016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-de9b813b-0515-4490-9f98-8f9b3fe1e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:56.075743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1398/2805] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:56.079864 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b8a44-292e-4cf8-9378-3c363dace08c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.089617 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b8a44-292e-4cf8-9378-3c363dace08c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.094244 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.094844 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.095124 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.095399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.096048 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:23:56.096354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.098024 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.110167 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1408/2806] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:23:56.114284 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b813b-0515-4490-9f98-8f9b3fe1e087 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.123243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b813b-0515-4490-9f98-8f9b3fe1e087 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.128792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558ab7-24d2-4cb5-aa8e-6e3f43e5692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.129378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558ab7-24d2-4cb5-aa8e-6e3f43e5692f admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.129682 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558ab7-24d2-4cb5-aa8e-6e3f43e5692f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.129958 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558ab7-24d2-4cb5-aa8e-6e3f43e5692f admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.130583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558ab7-24d2-4cb5-aa8e-6e3f43e5692f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.132467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558ab7-24d2-4cb5-aa8e-6e3f43e5692f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.162128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:56.172988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1399/2807] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:23:56 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:23:56.174149 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.184572 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b6e10-d4ad-4013-ab7c-6cdd06cc67d4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.240198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738b9b2-7198-40a4-b8df-de80266acb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.240793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b9b2-7198-40a4-b8df-de80266acb16 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.241077 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b9b2-7198-40a4-b8df-de80266acb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.241354 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b9b2-7198-40a4-b8df-de80266acb16 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.242013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738b9b2-7198-40a4-b8df-de80266acb16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.243923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738b9b2-7198-40a4-b8df-de80266acb16 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.265256 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1409/2808] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:23:56 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:23:56.269370 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558ab7-24d2-4cb5-aa8e-6e3f43e5692f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.279999 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558ab7-24d2-4cb5-aa8e-6e3f43e5692f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.284769 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848014c8-7f6d-4cf8-9c41-8f615eb3a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.285381 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848014c8-7f6d-4cf8-9c41-8f615eb3a9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.285705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848014c8-7f6d-4cf8-9c41-8f615eb3a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.285981 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848014c8-7f6d-4cf8-9c41-8f615eb3a9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.286642 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848014c8-7f6d-4cf8-9c41-8f615eb3a9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.288220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848014c8-7f6d-4cf8-9c41-8f615eb3a9c7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.299215 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1400/2809] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:23:56.303482 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738b9b2-7198-40a4-b8df-de80266acb16 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.314291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738b9b2-7198-40a4-b8df-de80266acb16 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.318901 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418adb00-1f76-41b8-aea9-4ab11c8505cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.319493 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418adb00-1f76-41b8-aea9-4ab11c8505cd admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.319776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418adb00-1f76-41b8-aea9-4ab11c8505cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.320111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418adb00-1f76-41b8-aea9-4ab11c8505cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.320756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418adb00-1f76-41b8-aea9-4ab11c8505cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.322387 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418adb00-1f76-41b8-aea9-4ab11c8505cd admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.332860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1410/2810] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:23:56.336804 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848014c8-7f6d-4cf8-9c41-8f615eb3a9c7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.347242 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848014c8-7f6d-4cf8-9c41-8f615eb3a9c7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.352018 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4910c4-0477-484f-a101-4abb136e5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.352722 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4910c4-0477-484f-a101-4abb136e5ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.352998 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4910c4-0477-484f-a101-4abb136e5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.353265 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4910c4-0477-484f-a101-4abb136e5ec0 admin admin] PATH_INFO: `/v3/projects/00b9cbe7f0584b69b8a02cc4e8d2a529/users/3c33715ef4bb4b42931229c0a1ac343f/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.368252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4910c4-0477-484f-a101-4abb136e5ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b9cbe7f0584b69b8a02cc4e8d2a529, user_id=3c33715ef4bb4b42931229c0a1ac343f, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.371106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4910c4-0477-484f-a101-4abb136e5ec0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.384222 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1401/2811] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:23:56 2022] PUT /identity/v3/projects/00b9cbe7f0584b69b8a02cc4e8d2a529/users/3c33715ef4bb4b42931229c0a1ac343f/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:56.396412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bac0-e980-4842-8302-0df9742c55d0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.396700 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bac0-e980-4842-8302-0df9742c55d0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.396976 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bac0-e980-4842-8302-0df9742c55d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.425653 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9a54bac0-e980-4842-8302-0df9742c55d0 None None] MFA Rules not processed for user `3c33715ef4bb4b42931229c0a1ac343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:56.426863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9a54bac0-e980-4842-8302-0df9742c55d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:56.447118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:56.492630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1411/2812] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:56.497105 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4910c4-0477-484f-a101-4abb136e5ec0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.558812 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4910c4-0477-484f-a101-4abb136e5ec0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.563762 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fbb52-7525-4236-9023-417b34299ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.564424 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fbb52-7525-4236-9023-417b34299ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.564703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fbb52-7525-4236-9023-417b34299ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.565022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fbb52-7525-4236-9023-417b34299ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.565635 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fbb52-7525-4236-9023-417b34299ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.567586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fbb52-7525-4236-9023-417b34299ab3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.601145 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1402/2813] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:23:56 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:23:56.605122 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54bac0-e980-4842-8302-0df9742c55d0 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.618415 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54bac0-e980-4842-8302-0df9742c55d0 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.678181 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa610b0-bfdc-4e0c-b813-949106c23fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.678803 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa610b0-bfdc-4e0c-b813-949106c23fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.679088 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa610b0-bfdc-4e0c-b813-949106c23fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.679366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa610b0-bfdc-4e0c-b813-949106c23fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.680012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa610b0-bfdc-4e0c-b813-949106c23fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.681968 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa610b0-bfdc-4e0c-b813-949106c23fb4 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.705822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1412/2814] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:23:56 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:23:56.708161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fbb52-7525-4236-9023-417b34299ab3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.718692 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fbb52-7525-4236-9023-417b34299ab3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.724143 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7c8e3-a610-445f-997d-9b8b30f74105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.724829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c8e3-a610-445f-997d-9b8b30f74105 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.725156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c8e3-a610-445f-997d-9b8b30f74105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.725498 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c8e3-a610-445f-997d-9b8b30f74105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.726252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7c8e3-a610-445f-997d-9b8b30f74105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.727990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7c8e3-a610-445f-997d-9b8b30f74105 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.738869 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1403/2815] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:23:56.743032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa610b0-bfdc-4e0c-b813-949106c23fb4 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.753560 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa610b0-bfdc-4e0c-b813-949106c23fb4 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.758180 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285933f2-b5a0-472c-8bc2-a46fe12b166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.758835 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285933f2-b5a0-472c-8bc2-a46fe12b166b admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.759118 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285933f2-b5a0-472c-8bc2-a46fe12b166b admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.759402 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285933f2-b5a0-472c-8bc2-a46fe12b166b admin admin] PATH_INFO: `/v3/projects/2e8e0fe08bd94111907c8c57d21d3ba7/users/1f15f0beb1b447b0beb508d528e47e7d/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.774606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285933f2-b5a0-472c-8bc2-a46fe12b166b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8e0fe08bd94111907c8c57d21d3ba7, user_id=1f15f0beb1b447b0beb508d528e47e7d, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.777267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285933f2-b5a0-472c-8bc2-a46fe12b166b admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.791616 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1413/2816] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:23:56 2022] PUT /identity/v3/projects/2e8e0fe08bd94111907c8c57d21d3ba7/users/1f15f0beb1b447b0beb508d528e47e7d/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:56.795652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7c8e3-a610-445f-997d-9b8b30f74105 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.805753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7c8e3-a610-445f-997d-9b8b30f74105 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.862027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f564827-5827-485d-8417-cf34f028a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.862553 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f564827-5827-485d-8417-cf34f028a6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.862836 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f564827-5827-485d-8417-cf34f028a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.863127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f564827-5827-485d-8417-cf34f028a6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.863757 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f564827-5827-485d-8417-cf34f028a6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.865345 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f564827-5827-485d-8417-cf34f028a6d0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.875127 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1404/2817] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:23:56.879588 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285933f2-b5a0-472c-8bc2-a46fe12b166b admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:56.889762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285933f2-b5a0-472c-8bc2-a46fe12b166b admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:56.894851 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:56.895495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.895777 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.896052 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] PATH_INFO: `/v3/projects/2e8e0fe08bd94111907c8c57d21d3ba7/users/1f15f0beb1b447b0beb508d528e47e7d/roles/c182619b007b495f912901d866e751e1` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.897969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8e0fe08bd94111907c8c57d21d3ba7, user_id=1f15f0beb1b447b0beb508d528e47e7d, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:56.900612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:56.911346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1414/2818] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:23:56 2022] PUT /identity/v3/projects/2e8e0fe08bd94111907c8c57d21d3ba7/users/1f15f0beb1b447b0beb508d528e47e7d/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:56.922748 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0a12-ade9-4596-b1f7-edc0c20eaae9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:56.923106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0a12-ade9-4596-b1f7-edc0c20eaae9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:56.923446 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0a12-ade9-4596-b1f7-edc0c20eaae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:56.952514 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-89ea0a12-ade9-4596-b1f7-edc0c20eaae9 None None] MFA Rules not processed for user `1f15f0beb1b447b0beb508d528e47e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:56.954392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-89ea0a12-ade9-4596-b1f7-edc0c20eaae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:56.978136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:57.023074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1405/2819] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:57.034659 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:57.036368 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:57.094366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebfbb6-9e8a-489c-8f83-34d0f952865d admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:57.097993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2f36b-d196-491b-904b-8019ad31818a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:57.098584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2f36b-d196-491b-904b-8019ad31818a service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:57.098861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2f36b-d196-491b-904b-8019ad31818a service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:57.099129 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2f36b-d196-491b-904b-8019ad31818a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:57.108028 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2f36b-d196-491b-904b-8019ad31818a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:57.109457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2f36b-d196-491b-904b-8019ad31818a service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:57.118967 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1415/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:23:57.523715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea0a12-ade9-4596-b1f7-edc0c20eaae9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:57.584241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea0a12-ade9-4596-b1f7-edc0c20eaae9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:57.588695 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:57.589312 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:57.589617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:57.589888 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] PATH_INFO: `/v3/users/3c33715ef4bb4b42931229c0a1ac343f` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:57.591007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c33715ef4bb4b42931229c0a1ac343f)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:57.592983 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:57.639118 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c33715ef4bb4b42931229c0a1ac343f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:57.646600 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c33715ef4bb4b42931229c0a1ac343f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:57.659785 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c33715ef4bb4b42931229c0a1ac343f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:57.660587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c33715ef4bb4b42931229c0a1ac343f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:57.669188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c33715ef4bb4b42931229c0a1ac343f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:57.677330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1406/2821] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:23:57 2022] DELETE /identity/v3/users/3c33715ef4bb4b42931229c0a1ac343f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:57.681854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a3b0b-43ef-4ac6-93e5-5bdacc8fae4a None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:57.685480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a3b0b-43ef-4ac6-93e5-5bdacc8fae4a None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:57.685758 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a3b0b-43ef-4ac6-93e5-5bdacc8fae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:57.717130 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-9e9a3b0b-43ef-4ac6-93e5-5bdacc8fae4a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:57.718393 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9e9a3b0b-43ef-4ac6-93e5-5bdacc8fae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:57.730254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:57.779502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1416/2822] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:57.789245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:57.790689 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:57.835852 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:57.852519 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d19f66-53d6-49dd-a132-e17db5a50a04 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:57.856186 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33682d8-e873-4877-8148-d0ec35aac402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:57.856790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33682d8-e873-4877-8148-d0ec35aac402 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:57.857084 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33682d8-e873-4877-8148-d0ec35aac402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:57.857338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33682d8-e873-4877-8148-d0ec35aac402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:57.867156 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33682d8-e873-4877-8148-d0ec35aac402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:57.868587 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33682d8-e873-4877-8148-d0ec35aac402 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:57.878283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1407/2823] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:23:58.145094 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a3b0b-43ef-4ac6-93e5-5bdacc8fae4a None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:58.146546 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-9e9a3b0b-43ef-4ac6-93e5-5bdacc8fae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:58.158709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a3b0b-43ef-4ac6-93e5-5bdacc8fae4a None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:58.163610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:58.164399 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:58.164782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:58.165159 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] PATH_INFO: `/v3/projects/00b9cbe7f0584b69b8a02cc4e8d2a529` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:58.166577 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b9cbe7f0584b69b8a02cc4e8d2a529)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:58.168481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:58.215439 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b9cbe7f0584b69b8a02cc4e8d2a529', 'request_id': 'req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.223099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b9cbe7f0584b69b8a02cc4e8d2a529', 'request_id': 'req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.228564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b9cbe7f0584b69b8a02cc4e8d2a529', 'request_id': 'req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.239333 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] The token cache is being invalidate because project 00b9cbe7f0584b69b8a02cc4e8d2a529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:23:58.239621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.240247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.241790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1417/2824] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:23:58 2022] DELETE /identity/v3/projects/00b9cbe7f0584b69b8a02cc4e8d2a529 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:58.245831 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33682d8-e873-4877-8148-d0ec35aac402 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:58.256004 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33682d8-e873-4877-8148-d0ec35aac402 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:58.314829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:58.315467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:58.315749 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:58.316023 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] PATH_INFO: `/v3/users/1f15f0beb1b447b0beb508d528e47e7d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:58.317188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f15f0beb1b447b0beb508d528e47e7d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:58.319959 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:58.368901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f15f0beb1b447b0beb508d528e47e7d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.376158 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f15f0beb1b447b0beb508d528e47e7d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.388205 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f15f0beb1b447b0beb508d528e47e7d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.388861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f15f0beb1b447b0beb508d528e47e7d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.396212 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7b6a94a0-9c51-421f-9c1a-aeb517b9d810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f15f0beb1b447b0beb508d528e47e7d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.401982 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1408/2825] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:23:58 2022] DELETE /identity/v3/users/1f15f0beb1b447b0beb508d528e47e7d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:58.696751 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:58.699163 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:58.714218 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7fb56-2a86-4aa9-86f9-d63c44c55e4f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:58.772543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:58.773201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:58.773512 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:58.773787 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] PATH_INFO: `/v3/projects/2e8e0fe08bd94111907c8c57d21d3ba7` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:58.774924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8e0fe08bd94111907c8c57d21d3ba7)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:58.776812 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:58.819713 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:58.825198 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8e0fe08bd94111907c8c57d21d3ba7', 'request_id': 'req-9982c539-cc7a-408d-9883-c8d02ec00562'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.833720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8e0fe08bd94111907c8c57d21d3ba7', 'request_id': 'req-9982c539-cc7a-408d-9883-c8d02ec00562'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.839692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8e0fe08bd94111907c8c57d21d3ba7', 'request_id': 'req-9982c539-cc7a-408d-9883-c8d02ec00562'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.851388 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] The token cache is being invalidate because project 2e8e0fe08bd94111907c8c57d21d3ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:23:58.851682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.852346 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-9982c539-cc7a-408d-9883-c8d02ec00562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:23:58.853892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1418/2826] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:23:58 2022] DELETE /identity/v3/projects/2e8e0fe08bd94111907c8c57d21d3ba7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:58.858754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad387f-bdf9-458c-890d-205544ba3c04 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:58.859225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad387f-bdf9-458c-890d-205544ba3c04 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:58.859335 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad387f-bdf9-458c-890d-205544ba3c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:58.879154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-82ad387f-bdf9-458c-890d-205544ba3c04 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:58.880392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-82ad387f-bdf9-458c-890d-205544ba3c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:58.944146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1409/2827] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:58.952220 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998980-f8b4-4769-9e1e-91475c4bc151 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:58.952557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998980-f8b4-4769-9e1e-91475c4bc151 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:58.952875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998980-f8b4-4769-9e1e-91475c4bc151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:58.973536 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-cb998980-f8b4-4769-9e1e-91475c4bc151 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:58.974791 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-cb998980-f8b4-4769-9e1e-91475c4bc151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:58.987005 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1419/2828] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:58.995385 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad387f-bdf9-458c-890d-205544ba3c04 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.002360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:59.011064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad387f-bdf9-458c-890d-205544ba3c04 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.017310 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.017997 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.018499 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.019005 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.019690 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:23:59.019992 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.021605 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.035842 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1410/2829] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:23:59.040366 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb998980-f8b4-4769-9e1e-91475c4bc151 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.050338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb998980-f8b4-4769-9e1e-91475c4bc151 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.055201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75757e-3d13-4b48-b728-f539facde38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.055915 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75757e-3d13-4b48-b728-f539facde38c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.056199 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75757e-3d13-4b48-b728-f539facde38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.056470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75757e-3d13-4b48-b728-f539facde38c admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.057098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75757e-3d13-4b48-b728-f539facde38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.059075 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75757e-3d13-4b48-b728-f539facde38c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.085782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1420/2830] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:23:59 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:23:59.089932 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.100244 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cf54a-54bb-4ba5-8f68-c3ce73d3ea3b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.155548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af533bb-5907-4d08-872a-ea5a74042ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.156252 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af533bb-5907-4d08-872a-ea5a74042ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.156645 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af533bb-5907-4d08-872a-ea5a74042ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.156916 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af533bb-5907-4d08-872a-ea5a74042ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.157578 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af533bb-5907-4d08-872a-ea5a74042ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.159473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af533bb-5907-4d08-872a-ea5a74042ba4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.180583 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1411/2831] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:23:59 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:23:59.184601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75757e-3d13-4b48-b728-f539facde38c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.195547 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75757e-3d13-4b48-b728-f539facde38c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.200090 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b114-940a-4879-8d14-b01713b88241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.200682 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b114-940a-4879-8d14-b01713b88241 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.200959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b114-940a-4879-8d14-b01713b88241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.201230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b114-940a-4879-8d14-b01713b88241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.201913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b114-940a-4879-8d14-b01713b88241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.203525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b114-940a-4879-8d14-b01713b88241 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.213206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1421/2832] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:23:59.216988 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af533bb-5907-4d08-872a-ea5a74042ba4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.227176 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af533bb-5907-4d08-872a-ea5a74042ba4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.231874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205013e5-0fbf-4ab4-af12-d44eb91d2c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.232467 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205013e5-0fbf-4ab4-af12-d44eb91d2c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.232751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205013e5-0fbf-4ab4-af12-d44eb91d2c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.233026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205013e5-0fbf-4ab4-af12-d44eb91d2c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.233714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205013e5-0fbf-4ab4-af12-d44eb91d2c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.236351 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205013e5-0fbf-4ab4-af12-d44eb91d2c41 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.251079 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1412/2833] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:23:59.255743 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b114-940a-4879-8d14-b01713b88241 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.265984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b114-940a-4879-8d14-b01713b88241 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.270663 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677a5b-98c8-463b-a232-b5371e3efb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.271412 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677a5b-98c8-463b-a232-b5371e3efb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.271696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677a5b-98c8-463b-a232-b5371e3efb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.271969 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677a5b-98c8-463b-a232-b5371e3efb85 admin admin] PATH_INFO: `/v3/projects/3c814885aa2c4b479a24b3c532731d38/users/a73128a204fe45bc928fba5b2182c757/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.289008 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f677a5b-98c8-463b-a232-b5371e3efb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c814885aa2c4b479a24b3c532731d38, user_id=a73128a204fe45bc928fba5b2182c757, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.291706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f677a5b-98c8-463b-a232-b5371e3efb85 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.305912 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1422/2834] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:23:59 2022] PUT /identity/v3/projects/3c814885aa2c4b479a24b3c532731d38/users/a73128a204fe45bc928fba5b2182c757/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:59.316751 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37382994-8a5d-4f64-9f44-45e341bc246b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.317034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37382994-8a5d-4f64-9f44-45e341bc246b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.317302 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37382994-8a5d-4f64-9f44-45e341bc246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.345673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-37382994-8a5d-4f64-9f44-45e341bc246b None None] MFA Rules not processed for user `a73128a204fe45bc928fba5b2182c757`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:59.347724 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-37382994-8a5d-4f64-9f44-45e341bc246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:59.417738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1413/2835] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:59.423013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677a5b-98c8-463b-a232-b5371e3efb85 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.483956 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677a5b-98c8-463b-a232-b5371e3efb85 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.489135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d093997-ff6a-4740-8db2-b414bb3fd0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.489768 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093997-ff6a-4740-8db2-b414bb3fd0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.490047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093997-ff6a-4740-8db2-b414bb3fd0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.490319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d093997-ff6a-4740-8db2-b414bb3fd0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.490949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d093997-ff6a-4740-8db2-b414bb3fd0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.492829 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d093997-ff6a-4740-8db2-b414bb3fd0d8 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.521337 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1423/2836] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:23:59 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:23:59.525251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37382994-8a5d-4f64-9f44-45e341bc246b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.536318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37382994-8a5d-4f64-9f44-45e341bc246b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.587368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:59.594616 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a813-8471-449d-8147-143f4c4c86d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.595220 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a813-8471-449d-8147-143f4c4c86d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.595517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a813-8471-449d-8147-143f4c4c86d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.595786 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a813-8471-449d-8147-143f4c4c86d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.596402 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199a813-8471-449d-8147-143f4c4c86d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.598362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199a813-8471-449d-8147-143f4c4c86d0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.619409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1414/2837] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:23:59 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:23:59.623386 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d093997-ff6a-4740-8db2-b414bb3fd0d8 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.634867 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d093997-ff6a-4740-8db2-b414bb3fd0d8 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.640584 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc8ab-a655-48ef-acb2-1ef302bb0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.641343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc8ab-a655-48ef-acb2-1ef302bb0f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.642000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc8ab-a655-48ef-acb2-1ef302bb0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.642496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc8ab-a655-48ef-acb2-1ef302bb0f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.643716 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc8ab-a655-48ef-acb2-1ef302bb0f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.645392 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc8ab-a655-48ef-acb2-1ef302bb0f5a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.657905 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1424/2838] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:23:59.662390 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a813-8471-449d-8147-143f4c4c86d0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.672948 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a813-8471-449d-8147-143f4c4c86d0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.677662 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ffb61-e6bf-4da9-adbe-01a14320f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.678301 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffb61-e6bf-4da9-adbe-01a14320f045 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.678612 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffb61-e6bf-4da9-adbe-01a14320f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.678884 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffb61-e6bf-4da9-adbe-01a14320f045 admin admin] PATH_INFO: `/v3/projects/2c8ec3bbcd1f4bb6a0e32cfab0396fda/users/b89678690ba84ce18016ff3cfd7b8af7/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.693256 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ffb61-e6bf-4da9-adbe-01a14320f045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8ec3bbcd1f4bb6a0e32cfab0396fda, user_id=b89678690ba84ce18016ff3cfd7b8af7, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.695941 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ffb61-e6bf-4da9-adbe-01a14320f045 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.709002 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1415/2839] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:23:59 2022] PUT /identity/v3/projects/2c8ec3bbcd1f4bb6a0e32cfab0396fda/users/b89678690ba84ce18016ff3cfd7b8af7/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:59.712908 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc8ab-a655-48ef-acb2-1ef302bb0f5a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.723576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc8ab-a655-48ef-acb2-1ef302bb0f5a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.763000 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:59.781278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb87e-8edc-42a1-874c-3b4c42a32e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.782478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb87e-8edc-42a1-874c-3b4c42a32e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.782830 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb87e-8edc-42a1-874c-3b4c42a32e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.783108 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb87e-8edc-42a1-874c-3b4c42a32e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.783744 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb87e-8edc-42a1-874c-3b4c42a32e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.785322 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb87e-8edc-42a1-874c-3b4c42a32e02 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.794923 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1425/2840] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:23:59.799191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ffb61-e6bf-4da9-adbe-01a14320f045 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.809464 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ffb61-e6bf-4da9-adbe-01a14320f045 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:23:59.814055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:23:59.814696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.814976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.815249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] PATH_INFO: `/v3/projects/2c8ec3bbcd1f4bb6a0e32cfab0396fda/users/b89678690ba84ce18016ff3cfd7b8af7/roles/c182619b007b495f912901d866e751e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.817142 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8ec3bbcd1f4bb6a0e32cfab0396fda, user_id=b89678690ba84ce18016ff3cfd7b8af7, role_id=c182619b007b495f912901d866e751e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:23:59.819789 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:23:59.830228 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1416/2841] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:23:59 2022] PUT /identity/v3/projects/2c8ec3bbcd1f4bb6a0e32cfab0396fda/users/b89678690ba84ce18016ff3cfd7b8af7/roles/c182619b007b495f912901d866e751e1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:23:59.841126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517992bc-a048-44dd-b218-3861c68a024c None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:23:59.841522 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517992bc-a048-44dd-b218-3861c68a024c None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:23:59.841861 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517992bc-a048-44dd-b218-3861c68a024c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:23:59.870797 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-517992bc-a048-44dd-b218-3861c68a024c None None] MFA Rules not processed for user `b89678690ba84ce18016ff3cfd7b8af7`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:23:59.872027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-517992bc-a048-44dd-b218-3861c68a024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:23:59.961628 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1426/2842] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:23:59.976887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:23:59.978727 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:00.037990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a54121-01e5-401b-8034-46f2a0dd5e6c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:00.041725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4e08-1b15-4ba4-a1fd-d4747501486a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:00.042337 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4e08-1b15-4ba4-a1fd-d4747501486a service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:00.042617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4e08-1b15-4ba4-a1fd-d4747501486a service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:00.042887 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4e08-1b15-4ba4-a1fd-d4747501486a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:00.051894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d4e08-1b15-4ba4-a1fd-d4747501486a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:00.053344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d4e08-1b15-4ba4-a1fd-d4747501486a service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:00.063161 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1417/2843] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:23:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:00.139278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517992bc-a048-44dd-b218-3861c68a024c None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:00.149495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517992bc-a048-44dd-b218-3861c68a024c None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:00.153047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb56aec-4ac9-40a2-9651-ea648c4227a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:00.153681 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb56aec-4ac9-40a2-9651-ea648c4227a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:00.153962 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb56aec-4ac9-40a2-9651-ea648c4227a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:00.154234 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb56aec-4ac9-40a2-9651-ea648c4227a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:00.211640 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb56aec-4ac9-40a2-9651-ea648c4227a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:00.213071 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb56aec-4ac9-40a2-9651-ea648c4227a8 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:00.222083 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1427/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:07.187900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4e08-1b15-4ba4-a1fd-d4747501486a service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:07.247059 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4e08-1b15-4ba4-a1fd-d4747501486a service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:07.251489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:07.252373 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:07.253968 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:07.254247 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] PATH_INFO: `/v3/users/a73128a204fe45bc928fba5b2182c757` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:07.255955 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73128a204fe45bc928fba5b2182c757)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:07.258071 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:07.304461 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73128a204fe45bc928fba5b2182c757'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.311521 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73128a204fe45bc928fba5b2182c757'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.312845 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:07.326537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73128a204fe45bc928fba5b2182c757'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.327224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73128a204fe45bc928fba5b2182c757'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.334687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73128a204fe45bc928fba5b2182c757'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.340431 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1418/2845] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:24:07 2022] DELETE /identity/v3/users/a73128a204fe45bc928fba5b2182c757 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:07.344889 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68be0a-fd47-47b0-9909-6e1d8424b667 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:07.345428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68be0a-fd47-47b0-9909-6e1d8424b667 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:07.345553 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68be0a-fd47-47b0-9909-6e1d8424b667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:07.365643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-af68be0a-fd47-47b0-9909-6e1d8424b667 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:07.366836 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-af68be0a-fd47-47b0-9909-6e1d8424b667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:07.424924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1428/2846] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:24:07.434429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:07.435859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:07.492157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746997c-2ec3-4ea2-888b-c5eb7f416765 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:07.495859 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b650cb-da38-45d8-be4a-826b6e1bb953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:07.496505 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b650cb-da38-45d8-be4a-826b6e1bb953 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:07.496782 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b650cb-da38-45d8-be4a-826b6e1bb953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:07.497050 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b650cb-da38-45d8-be4a-826b6e1bb953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:07.506597 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b650cb-da38-45d8-be4a-826b6e1bb953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:07.508035 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b650cb-da38-45d8-be4a-826b6e1bb953 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:07.519232 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1419/2847] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:07.781434 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68be0a-fd47-47b0-9909-6e1d8424b667 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:07.782926 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-af68be0a-fd47-47b0-9909-6e1d8424b667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:07.790247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=100 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:07.800778 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68be0a-fd47-47b0-9909-6e1d8424b667 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:07.805601 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:07.806235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:07.806515 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:07.806790 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] PATH_INFO: `/v3/projects/3c814885aa2c4b479a24b3c532731d38` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:07.808057 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c814885aa2c4b479a24b3c532731d38)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:07.809914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:07.857513 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c814885aa2c4b479a24b3c532731d38', 'request_id': 'req-b5d09883-cb3b-4a67-9259-3c380a4e13d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.864748 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c814885aa2c4b479a24b3c532731d38', 'request_id': 'req-b5d09883-cb3b-4a67-9259-3c380a4e13d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.870267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c814885aa2c4b479a24b3c532731d38', 'request_id': 'req-b5d09883-cb3b-4a67-9259-3c380a4e13d0'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.881789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] The token cache is being invalidate because project 3c814885aa2c4b479a24b3c532731d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:24:07.882106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.882766 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:07.884299 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1429/2848] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:24:07 2022] DELETE /identity/v3/projects/3c814885aa2c4b479a24b3c532731d38 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:07.888223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b650cb-da38-45d8-be4a-826b6e1bb953 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:07.898485 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b650cb-da38-45d8-be4a-826b6e1bb953 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:07.954418 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:07.955048 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:07.955326 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:07.955599 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] PATH_INFO: `/v3/users/b89678690ba84ce18016ff3cfd7b8af7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:07.956761 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89678690ba84ce18016ff3cfd7b8af7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:07.958715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:08.006688 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89678690ba84ce18016ff3cfd7b8af7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.013946 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89678690ba84ce18016ff3cfd7b8af7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.025850 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89678690ba84ce18016ff3cfd7b8af7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.026491 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89678690ba84ce18016ff3cfd7b8af7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.030902 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:08.034796 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0bc5573c-7ab5-4d78-b677-e626fb627fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89678690ba84ce18016ff3cfd7b8af7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.041481 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1420/2849] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:24:07 2022] DELETE /identity/v3/users/b89678690ba84ce18016ff3cfd7b8af7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:08.315201 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:08.316222 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:08.329120 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d09883-cb3b-4a67-9259-3c380a4e13d0 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:08.389247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:08.390006 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.390239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.390498 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] PATH_INFO: `/v3/projects/2c8ec3bbcd1f4bb6a0e32cfab0396fda` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.391608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8ec3bbcd1f4bb6a0e32cfab0396fda)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:08.394106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:08.438446 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8ec3bbcd1f4bb6a0e32cfab0396fda', 'request_id': 'req-0d722a1c-021d-452f-b9c8-60402bafa6a5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.448104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8ec3bbcd1f4bb6a0e32cfab0396fda', 'request_id': 'req-0d722a1c-021d-452f-b9c8-60402bafa6a5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.454027 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8ec3bbcd1f4bb6a0e32cfab0396fda', 'request_id': 'req-0d722a1c-021d-452f-b9c8-60402bafa6a5'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.466133 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] The token cache is being invalidate because project 2c8ec3bbcd1f4bb6a0e32cfab0396fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:24:08.466426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.467061 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-0d722a1c-021d-452f-b9c8-60402bafa6a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:08.468556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1430/2850] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:24:08 2022] DELETE /identity/v3/projects/2c8ec3bbcd1f4bb6a0e32cfab0396fda => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:08.474933 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c3a30-b008-42aa-bfef-ea08b202ffc9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.475430 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c3a30-b008-42aa-bfef-ea08b202ffc9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.475535 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c3a30-b008-42aa-bfef-ea08b202ffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.494665 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-826c3a30-b008-42aa-bfef-ea08b202ffc9 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:08.495880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-826c3a30-b008-42aa-bfef-ea08b202ffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:08.555114 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1421/2851] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:08.562887 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdecbd-2f60-41a0-a21d-901c792258ea None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.563171 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdecbd-2f60-41a0-a21d-901c792258ea None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.563447 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdecbd-2f60-41a0-a21d-901c792258ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.584257 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-89cdecbd-2f60-41a0-a21d-901c792258ea None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:08.585480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-89cdecbd-2f60-41a0-a21d-901c792258ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:08.593273 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1431/2852] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:08.597469 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c3a30-b008-42aa-bfef-ea08b202ffc9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:08.607162 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c3a30-b008-42aa-bfef-ea08b202ffc9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:08.611754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:08.612354 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.612638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.612911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.613586 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:24:08.613891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:08.615515 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:08.627477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1422/2853] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:24:08.631696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdecbd-2f60-41a0-a21d-901c792258ea None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:08.641544 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdecbd-2f60-41a0-a21d-901c792258ea None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:08.647206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fb11f-7fb9-44d4-913d-d3872b405325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:08.647815 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fb11f-7fb9-44d4-913d-d3872b405325 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.648111 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fb11f-7fb9-44d4-913d-d3872b405325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.648372 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fb11f-7fb9-44d4-913d-d3872b405325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.649018 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fb11f-7fb9-44d4-913d-d3872b405325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:08.650959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fb11f-7fb9-44d4-913d-d3872b405325 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:08.656401 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:08.679822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1432/2854] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:24:08 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:24:08.683901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:08.694543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04800e-0698-4d85-a7d5-aa088aaa1e6d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:08.749501 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd15f1-f329-4cad-9675-7f4cd739e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:08.750100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd15f1-f329-4cad-9675-7f4cd739e124 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.750384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd15f1-f329-4cad-9675-7f4cd739e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.750656 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd15f1-f329-4cad-9675-7f4cd739e124 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.751289 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd15f1-f329-4cad-9675-7f4cd739e124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:08.753800 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd15f1-f329-4cad-9675-7f4cd739e124 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:08.775154 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1423/2855] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:24:08 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:24:08.779206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fb11f-7fb9-44d4-913d-d3872b405325 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:08.789457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fb11f-7fb9-44d4-913d-d3872b405325 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:08.794044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218ae06-1d04-4a2d-b8e0-5b34be55589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:08.794643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ae06-1d04-4a2d-b8e0-5b34be55589a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.794928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ae06-1d04-4a2d-b8e0-5b34be55589a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.795206 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ae06-1d04-4a2d-b8e0-5b34be55589a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.795854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218ae06-1d04-4a2d-b8e0-5b34be55589a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:08.797480 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218ae06-1d04-4a2d-b8e0-5b34be55589a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:08.807794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1433/2856] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:24:08.811545 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd15f1-f329-4cad-9675-7f4cd739e124 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:08.821976 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd15f1-f329-4cad-9675-7f4cd739e124 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:08.826641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9f424-1926-49b7-89d8-7a1ddc72b35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:08.827250 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9f424-1926-49b7-89d8-7a1ddc72b35a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.827532 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9f424-1926-49b7-89d8-7a1ddc72b35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.827805 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9f424-1926-49b7-89d8-7a1ddc72b35a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.828436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9f424-1926-49b7-89d8-7a1ddc72b35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:08.830128 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9f424-1926-49b7-89d8-7a1ddc72b35a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:08.840436 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1424/2857] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:24:08.844225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218ae06-1d04-4a2d-b8e0-5b34be55589a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:08.854142 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218ae06-1d04-4a2d-b8e0-5b34be55589a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:08.858883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:08.859525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.859809 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.860087 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] PATH_INFO: `/v3/projects/fb7f2a05bc1941af99efbdb88b0b1aa4/users/28304562b6054287ac57024fb0c3be95/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.875353 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7f2a05bc1941af99efbdb88b0b1aa4, user_id=28304562b6054287ac57024fb0c3be95, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:08.878703 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:08.891757 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1434/2858] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:24:08 2022] PUT /identity/v3/projects/fb7f2a05bc1941af99efbdb88b0b1aa4/users/28304562b6054287ac57024fb0c3be95/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:24:08.901849 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fadd-ae77-439a-a70b-46f23ee3c851 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:08.902135 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fadd-ae77-439a-a70b-46f23ee3c851 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:08.902408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4fadd-ae77-439a-a70b-46f23ee3c851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:08.929820 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0ca4fadd-ae77-439a-a70b-46f23ee3c851 None None] MFA Rules not processed for user `28304562b6054287ac57024fb0c3be95`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:08.931016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0ca4fadd-ae77-439a-a70b-46f23ee3c851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:08.976298 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:08.995350 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1425/2859] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:09.007170 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:09.008843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:09.065571 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392bc6a-6690-41e8-a97e-54d2959c1230 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:09.069276 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1897b9-9281-4856-b9f1-6f4ee44ec137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:09.069913 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1897b9-9281-4856-b9f1-6f4ee44ec137 service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:09.070200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1897b9-9281-4856-b9f1-6f4ee44ec137 service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:09.070481 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1897b9-9281-4856-b9f1-6f4ee44ec137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:09.078725 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1897b9-9281-4856-b9f1-6f4ee44ec137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:09.080157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1897b9-9281-4856-b9f1-6f4ee44ec137 service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:09.088841 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1435/2860] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:18.992356 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:19.084892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:20.494754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4fadd-ae77-439a-a70b-46f23ee3c851 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:20.558714 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4fadd-ae77-439a-a70b-46f23ee3c851 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:20.563306 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:20.563931 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:20.564211 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:20.564483 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] PATH_INFO: `/v3/users/28304562b6054287ac57024fb0c3be95` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:20.565644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28304562b6054287ac57024fb0c3be95)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:20.567566 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:20.614069 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28304562b6054287ac57024fb0c3be95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:20.621208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28304562b6054287ac57024fb0c3be95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:20.634005 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28304562b6054287ac57024fb0c3be95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:20.634672 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28304562b6054287ac57024fb0c3be95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:20.641627 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28304562b6054287ac57024fb0c3be95'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:20.648010 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1426/2861] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:24:20 2022] DELETE /identity/v3/users/28304562b6054287ac57024fb0c3be95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:20.652485 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930520c-33b0-4cf8-bbe7-c95e8bf632de None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:20.652951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930520c-33b0-4cf8-bbe7-c95e8bf632de None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:20.653089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930520c-33b0-4cf8-bbe7-c95e8bf632de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:20.671966 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2930520c-33b0-4cf8-bbe7-c95e8bf632de None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:20.673265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2930520c-33b0-4cf8-bbe7-c95e8bf632de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:20.733002 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1436/2862] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 01:24:20.742564 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:20.743950 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:20.800384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128c32-a57b-48d4-b73e-ca4e08d9c032 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:20.804074 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0079a6a-fa40-4ab6-ab84-c9838692b926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:20.804673 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0079a6a-fa40-4ab6-ab84-c9838692b926 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:20.804953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0079a6a-fa40-4ab6-ab84-c9838692b926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:20.805225 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0079a6a-fa40-4ab6-ab84-c9838692b926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:20.814318 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0079a6a-fa40-4ab6-ab84-c9838692b926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:20.815743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0079a6a-fa40-4ab6-ab84-c9838692b926 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:20.825556 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1427/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:21.084916 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930520c-33b0-4cf8-bbe7-c95e8bf632de None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:21.086573 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2930520c-33b0-4cf8-bbe7-c95e8bf632de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:21.099435 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930520c-33b0-4cf8-bbe7-c95e8bf632de None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:21.104726 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:21.105742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.105891 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.106106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] PATH_INFO: `/v3/projects/fb7f2a05bc1941af99efbdb88b0b1aa4` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.107379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7f2a05bc1941af99efbdb88b0b1aa4)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:21.109269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:21.159656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7f2a05bc1941af99efbdb88b0b1aa4', 'request_id': 'req-07bb9896-07b3-4927-8327-31b03d6cbb63'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:21.166917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7f2a05bc1941af99efbdb88b0b1aa4', 'request_id': 'req-07bb9896-07b3-4927-8327-31b03d6cbb63'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:21.173457 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7f2a05bc1941af99efbdb88b0b1aa4', 'request_id': 'req-07bb9896-07b3-4927-8327-31b03d6cbb63'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:21.185210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] The token cache is being invalidate because project fb7f2a05bc1941af99efbdb88b0b1aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:24:21.185531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:21.186188 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-07bb9896-07b3-4927-8327-31b03d6cbb63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:21.187692 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1437/2864] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:24:21 2022] DELETE /identity/v3/projects/fb7f2a05bc1941af99efbdb88b0b1aa4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:21.192905 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f40b-720c-44f3-ae4c-3f537123cd90 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.193188 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f40b-720c-44f3-ae4c-3f537123cd90 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.194107 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1f40b-720c-44f3-ae4c-3f537123cd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.213039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-98a1f40b-720c-44f3-ae4c-3f537123cd90 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:21.214251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-98a1f40b-720c-44f3-ae4c-3f537123cd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:21.230443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:21.277957 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1428/2865] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:21.286677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff460829-adf9-4827-9af2-65d98b001996 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.286965 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff460829-adf9-4827-9af2-65d98b001996 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.287266 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff460829-adf9-4827-9af2-65d98b001996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.307233 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ff460829-adf9-4827-9af2-65d98b001996 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:21.308437 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ff460829-adf9-4827-9af2-65d98b001996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:21.316203 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1438/2866] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:21.320775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f40b-720c-44f3-ae4c-3f537123cd90 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:21.330241 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1f40b-720c-44f3-ae4c-3f537123cd90 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:21.334743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:21.335331 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.335609 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.335876 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.336509 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:24:21.336807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:21.338414 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:21.350042 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1429/2867] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:24:21.354127 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff460829-adf9-4827-9af2-65d98b001996 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:21.363287 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff460829-adf9-4827-9af2-65d98b001996 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:21.368566 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddee391-15c1-4d71-8b25-c361e1d67d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:21.369152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddee391-15c1-4d71-8b25-c361e1d67d7a admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.369464 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddee391-15c1-4d71-8b25-c361e1d67d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.369740 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddee391-15c1-4d71-8b25-c361e1d67d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.370365 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddee391-15c1-4d71-8b25-c361e1d67d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:21.372239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddee391-15c1-4d71-8b25-c361e1d67d7a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:21.398847 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1439/2868] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:24:21 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:24:21.402840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:21.413070 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78b3b-e8e4-4bd4-8c80-e6abc1e12c40 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:21.466935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21617ef-c72e-411a-b0fc-bda91b23688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:21.467462 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21617ef-c72e-411a-b0fc-bda91b23688c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.467774 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21617ef-c72e-411a-b0fc-bda91b23688c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.468047 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21617ef-c72e-411a-b0fc-bda91b23688c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.468663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21617ef-c72e-411a-b0fc-bda91b23688c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:21.470629 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21617ef-c72e-411a-b0fc-bda91b23688c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:21.492110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1430/2869] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:24:21 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:24:21.496291 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddee391-15c1-4d71-8b25-c361e1d67d7a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:21.506951 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddee391-15c1-4d71-8b25-c361e1d67d7a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:21.511865 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9677-c535-47c4-b643-e9edb3b8c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:21.512468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9677-c535-47c4-b643-e9edb3b8c124 admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.512747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9677-c535-47c4-b643-e9edb3b8c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.513015 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9677-c535-47c4-b643-e9edb3b8c124 admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.513688 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f9677-c535-47c4-b643-e9edb3b8c124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:21.515275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f9677-c535-47c4-b643-e9edb3b8c124 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:21.525267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1440/2870] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:24:21.529206 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21617ef-c72e-411a-b0fc-bda91b23688c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:21.539728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21617ef-c72e-411a-b0fc-bda91b23688c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:21.544311 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35330f85-2c67-4bce-a582-208486878a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:21.544894 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330f85-2c67-4bce-a582-208486878a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.545174 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330f85-2c67-4bce-a582-208486878a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.545479 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35330f85-2c67-4bce-a582-208486878a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.546146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35330f85-2c67-4bce-a582-208486878a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:21.547721 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35330f85-2c67-4bce-a582-208486878a8f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:21.558738 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1431/2871] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:24:21.562625 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9677-c535-47c4-b643-e9edb3b8c124 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:21.572329 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9677-c535-47c4-b643-e9edb3b8c124 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:21.576856 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:21.577523 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.577805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.578078 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] PATH_INFO: `/v3/projects/d221cde4a79849289a9257d5b4055609/users/1c3f317ea93c4221ad40fdc735115ae7/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.592645 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d221cde4a79849289a9257d5b4055609, user_id=1c3f317ea93c4221ad40fdc735115ae7, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:21.595307 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:21.608568 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1441/2872] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:24:21 2022] PUT /identity/v3/projects/d221cde4a79849289a9257d5b4055609/users/1c3f317ea93c4221ad40fdc735115ae7/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:21.618780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d79e7-341d-4a91-94b4-34a7a18d11c1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.619067 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d79e7-341d-4a91-94b4-34a7a18d11c1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.619341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d79e7-341d-4a91-94b4-34a7a18d11c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.650400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f16d79e7-341d-4a91-94b4-34a7a18d11c1 None None] MFA Rules not processed for user `1c3f317ea93c4221ad40fdc735115ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:21.651643 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f16d79e7-341d-4a91-94b4-34a7a18d11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:21.715696 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1432/2873] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:21.727613 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:21.729290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:21.751541 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:21.788685 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eeea2-bdd8-4021-8e7e-ab5ec0d7ea22 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:21.792378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660c27-8e7d-47d6-b4b5-859d98163be1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d637726e3142e6ba90fa201c764b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:21.792979 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660c27-8e7d-47d6-b4b5-859d98163be1 service glance] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:21.793261 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660c27-8e7d-47d6-b4b5-859d98163be1 service glance] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:21.793576 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660c27-8e7d-47d6-b4b5-859d98163be1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:21.801854 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22660c27-8e7d-47d6-b4b5-859d98163be1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:21.803781 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22660c27-8e7d-47d6-b4b5-859d98163be1 service glance] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:21.812542 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1442/2874] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:31.712409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:31.808629 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=17 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:42.264317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d79e7-341d-4a91-94b4-34a7a18d11c1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:42.325460 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d79e7-341d-4a91-94b4-34a7a18d11c1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:42.330001 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:42.330595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:42.330874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:42.331146 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] PATH_INFO: `/v3/users/1c3f317ea93c4221ad40fdc735115ae7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:42.332245 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3f317ea93c4221ad40fdc735115ae7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:42.334183 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:42.380979 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3f317ea93c4221ad40fdc735115ae7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.389007 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3f317ea93c4221ad40fdc735115ae7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.401964 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3f317ea93c4221ad40fdc735115ae7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.403100 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3f317ea93c4221ad40fdc735115ae7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.409898 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3f317ea93c4221ad40fdc735115ae7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.415705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1433/2875] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:24:42 2022] DELETE /identity/v3/users/1c3f317ea93c4221ad40fdc735115ae7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:42.421019 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646e55-9686-4e06-af10-a49aa0ee59b4 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:42.421897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646e55-9686-4e06-af10-a49aa0ee59b4 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:42.422183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d646e55-9686-4e06-af10-a49aa0ee59b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:42.441531 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3d646e55-9686-4e06-af10-a49aa0ee59b4 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:42.442741 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3d646e55-9686-4e06-af10-a49aa0ee59b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:42.500706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1443/2876] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:42.511517 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:42.512940 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:42.569652 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c239dca-ddb1-4f87-a6b9-011408c91795 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:42.573295 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b81a-611e-4dd4-b2b3-1e9972bdde00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:42.574432 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b81a-611e-4dd4-b2b3-1e9972bdde00 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:42.574715 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b81a-611e-4dd4-b2b3-1e9972bdde00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:42.574990 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b81a-611e-4dd4-b2b3-1e9972bdde00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:42.584170 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b81a-611e-4dd4-b2b3-1e9972bdde00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:42.585537 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b81a-611e-4dd4-b2b3-1e9972bdde00 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:42.595668 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1434/2877] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:42.854974 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d646e55-9686-4e06-af10-a49aa0ee59b4 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:42.856408 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3d646e55-9686-4e06-af10-a49aa0ee59b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:42.868426 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d646e55-9686-4e06-af10-a49aa0ee59b4 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:42.873230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:42.873897 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:42.874183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:42.874456 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] PATH_INFO: `/v3/projects/d221cde4a79849289a9257d5b4055609` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:42.875579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d221cde4a79849289a9257d5b4055609)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:42.877789 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:42.924949 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd221cde4a79849289a9257d5b4055609', 'request_id': 'req-94dd874e-92fd-4c86-b06f-e41605f1b76e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.932012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd221cde4a79849289a9257d5b4055609', 'request_id': 'req-94dd874e-92fd-4c86-b06f-e41605f1b76e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.938258 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd221cde4a79849289a9257d5b4055609', 'request_id': 'req-94dd874e-92fd-4c86-b06f-e41605f1b76e'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.949826 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] The token cache is being invalidate because project d221cde4a79849289a9257d5b4055609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:24:42.950112 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.950739 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-94dd874e-92fd-4c86-b06f-e41605f1b76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:24:42.952200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1444/2878] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:24:42 2022] DELETE /identity/v3/projects/d221cde4a79849289a9257d5b4055609 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:24:42.957030 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb0c0-8813-4d0c-b623-284c39f6c6b3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:42.957316 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb0c0-8813-4d0c-b623-284c39f6c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:42.957615 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb0c0-8813-4d0c-b623-284c39f6c6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:42.977527 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-862eb0c0-8813-4d0c-b623-284c39f6c6b3 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:42.978707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-862eb0c0-8813-4d0c-b623-284c39f6c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:42.997160 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:43.041995 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1435/2879] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:43.050981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef940f6a-047f-4615-b934-eed7a63ed499 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.051268 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef940f6a-047f-4615-b934-eed7a63ed499 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.051548 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef940f6a-047f-4615-b934-eed7a63ed499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.071478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ef940f6a-047f-4615-b934-eed7a63ed499 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:43.072677 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ef940f6a-047f-4615-b934-eed7a63ed499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:43.081126 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1445/2880] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:43.085240 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eb0c0-8813-4d0c-b623-284c39f6c6b3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:43.094956 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eb0c0-8813-4d0c-b623-284c39f6c6b3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:43.099543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:43.100133 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.100411 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.100679 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.101315 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:24:43.101646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:43.103223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:43.114450 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1436/2881] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:24:43.118468 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef940f6a-047f-4615-b934-eed7a63ed499 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:43.128225 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef940f6a-047f-4615-b934-eed7a63ed499 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:43.132985 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91d0c2-b685-4f07-8c60-0b7acfb94a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:43.133607 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91d0c2-b685-4f07-8c60-0b7acfb94a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.133886 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91d0c2-b685-4f07-8c60-0b7acfb94a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.134156 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91d0c2-b685-4f07-8c60-0b7acfb94a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.134792 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91d0c2-b685-4f07-8c60-0b7acfb94a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:43.137331 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91d0c2-b685-4f07-8c60-0b7acfb94a7c admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:43.164036 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1446/2882] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:24:43 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:24:43.168828 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:43.178840 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b526df9-857e-4948-bd69-462baa5c3538 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:43.234262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e786132-0886-4351-bc9d-1fcfd4e26b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:43.234857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786132-0886-4351-bc9d-1fcfd4e26b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.235136 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786132-0886-4351-bc9d-1fcfd4e26b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.235407 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786132-0886-4351-bc9d-1fcfd4e26b46 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.236031 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e786132-0886-4351-bc9d-1fcfd4e26b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:43.238006 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e786132-0886-4351-bc9d-1fcfd4e26b46 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:43.258664 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1437/2883] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:24:43 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:24:43.262928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91d0c2-b685-4f07-8c60-0b7acfb94a7c admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:43.272973 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91d0c2-b685-4f07-8c60-0b7acfb94a7c admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:43.279612 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d5355-f22c-47b1-b013-2746d17f395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:43.280494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d5355-f22c-47b1-b013-2746d17f395a admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.280983 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d5355-f22c-47b1-b013-2746d17f395a admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.281502 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d5355-f22c-47b1-b013-2746d17f395a admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.282247 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d5355-f22c-47b1-b013-2746d17f395a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:43.284210 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d5355-f22c-47b1-b013-2746d17f395a admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:43.295495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1447/2884] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:24:43.299493 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e786132-0886-4351-bc9d-1fcfd4e26b46 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:43.309344 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e786132-0886-4351-bc9d-1fcfd4e26b46 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:43.313909 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ccb5a-0ccc-4c6d-8429-908988e8a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:43.314495 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ccb5a-0ccc-4c6d-8429-908988e8a8da admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.314771 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ccb5a-0ccc-4c6d-8429-908988e8a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.315036 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ccb5a-0ccc-4c6d-8429-908988e8a8da admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.315699 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ccb5a-0ccc-4c6d-8429-908988e8a8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:43.317273 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ccb5a-0ccc-4c6d-8429-908988e8a8da admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:43.328076 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1438/2885] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:24:43.332119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d5355-f22c-47b1-b013-2746d17f395a admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:43.342687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d5355-f22c-47b1-b013-2746d17f395a admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:43.347278 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:43.347914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.348196 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.348497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] PATH_INFO: `/v3/projects/3b0df56a24e74553aa79fed362d40180/users/ada09d6f9b7142d982fdb04cc15aa9d1/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.362762 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0df56a24e74553aa79fed362d40180, user_id=ada09d6f9b7142d982fdb04cc15aa9d1, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:43.365463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:43.378227 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1448/2886] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:24:43 2022] PUT /identity/v3/projects/3b0df56a24e74553aa79fed362d40180/users/ada09d6f9b7142d982fdb04cc15aa9d1/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:24:43.388802 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3545d-b9e0-434f-bdc7-ca08e5b67b52 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.389086 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3545d-b9e0-434f-bdc7-ca08e5b67b52 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.389384 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3545d-b9e0-434f-bdc7-ca08e5b67b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.417763 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ffb3545d-b9e0-434f-bdc7-ca08e5b67b52 None None] MFA Rules not processed for user `ada09d6f9b7142d982fdb04cc15aa9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:43.419595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ffb3545d-b9e0-434f-bdc7-ca08e5b67b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:43.499886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1439/2887] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:43.511186 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:43.513532 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:43.535954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:43.573306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a0f79-567b-49b0-a07b-97a2c8b52f89 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:43.577336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:43.578093 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:43.578371 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:43.578643 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:43.587031 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:43.588476 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:43.598304 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1449/2888] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:45.135707 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d9fd-9cf3-4a43-b873-b8547112767b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:45.136239 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d9fd-9cf3-4a43-b873-b8547112767b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:45.136392 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d9fd-9cf3-4a43-b873-b8547112767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:45.157732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8785d9fd-9cf3-4a43-b873-b8547112767b None None] MFA Rules not processed for user `ada09d6f9b7142d982fdb04cc15aa9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:24:45.159026 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8785d9fd-9cf3-4a43-b873-b8547112767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:45.166214 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1440/2889] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:24:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:24:46.638534 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:46.639938 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:46.723420 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304116b3-2762-437c-a905-800b3bfc714c service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:46.728805 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:46.729452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:46.729769 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:46.730012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:46.731770 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:46.743992 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:46.745604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:46.756760 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1450/2890] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:51.644885 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785d9fd-9cf3-4a43-b873-b8547112767b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:51.646353 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8785d9fd-9cf3-4a43-b873-b8547112767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:51.660393 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:51.708700 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785d9fd-9cf3-4a43-b873-b8547112767b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:51.712330 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e395115-1ada-4e4b-9fe2-d9faf8057a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:51.712934 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395115-1ada-4e4b-9fe2-d9faf8057a0f service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:51.713216 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395115-1ada-4e4b-9fe2-d9faf8057a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:51.713529 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395115-1ada-4e4b-9fe2-d9faf8057a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:51.715347 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8e395115-1ada-4e4b-9fe2-d9faf8057a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:51.724943 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e395115-1ada-4e4b-9fe2-d9faf8057a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:51.726400 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e395115-1ada-4e4b-9fe2-d9faf8057a0f service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:51.734408 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1441/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:24:52.656496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:24:52.659135 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:52.745032 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79877-333f-46d5-94ce-4b96fcf1a385 service placement] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:24:52.750405 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:24:52.751013 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:24:52.751292 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:24:52.751562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:24:52.753562 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:24:52.766229 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:24:52.767799 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:24:52.778604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1451/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:24:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 01:25:01.730853 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=21 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:02.773980 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=83 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:03.401592 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f374de-4ef7-4493-9686-6959c29b31e4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:03.402099 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f374de-4ef7-4493-9686-6959c29b31e4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:03.402209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f374de-4ef7-4493-9686-6959c29b31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:03.449777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-78f374de-4ef7-4493-9686-6959c29b31e4 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:03.450967 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-78f374de-4ef7-4493-9686-6959c29b31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:03.512891 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1442/2893] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:03.558448 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:03.559860 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:03.649982 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed648f81-52af-4e5a-bd45-087a7849495b service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:03.655404 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad37ef-2c9b-4f7c-8912-546f8a99d823 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:03.655995 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad37ef-2c9b-4f7c-8912-546f8a99d823 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:03.656275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad37ef-2c9b-4f7c-8912-546f8a99d823 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:03.656543 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad37ef-2c9b-4f7c-8912-546f8a99d823 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:03.664443 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad37ef-2c9b-4f7c-8912-546f8a99d823 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:03.666045 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad37ef-2c9b-4f7c-8912-546f8a99d823 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:03.674678 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1452/2894] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:25:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:25:04.166055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfbe7-e3e8-4c9c-bbf3-c5f51f591d05 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:04.166343 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfbe7-e3e8-4c9c-bbf3-c5f51f591d05 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:04.166617 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfbe7-e3e8-4c9c-bbf3-c5f51f591d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:04.185258 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d02cfbe7-e3e8-4c9c-bbf3-c5f51f591d05 None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:04.186486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d02cfbe7-e3e8-4c9c-bbf3-c5f51f591d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:04.193508 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1443/2895] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 8 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:04.206117 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad37ef-2c9b-4f7c-8912-546f8a99d823 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:04.216746 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad37ef-2c9b-4f7c-8912-546f8a99d823 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:04.222469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efeb97-527b-4cef-bbe1-f9a2df2b7146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:04.223064 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efeb97-527b-4cef-bbe1-f9a2df2b7146 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:04.223345 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efeb97-527b-4cef-bbe1-f9a2df2b7146 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:04.223621 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efeb97-527b-4cef-bbe1-f9a2df2b7146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:04.231673 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efeb97-527b-4cef-bbe1-f9a2df2b7146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:04.233252 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efeb97-527b-4cef-bbe1-f9a2df2b7146 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:04.241407 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1453/2896] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:25:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:25:04.471427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcf9e-3df0-4e27-8f73-ad5644a41afb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:04.471935 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcf9e-3df0-4e27-8f73-ad5644a41afb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:04.472041 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcf9e-3df0-4e27-8f73-ad5644a41afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:04.491743 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-27fbcf9e-3df0-4e27-8f73-ad5644a41afb None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:04.492925 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-27fbcf9e-3df0-4e27-8f73-ad5644a41afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:04.500366 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1444/2897] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Sep 8 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:04.515289 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efeb97-527b-4cef-bbe1-f9a2df2b7146 service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:04.526235 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efeb97-527b-4cef-bbe1-f9a2df2b7146 service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:04.531202 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744875f4-6354-4a00-9516-648ec388985e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:04.531794 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744875f4-6354-4a00-9516-648ec388985e service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:04.532104 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744875f4-6354-4a00-9516-648ec388985e service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:04.532379 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744875f4-6354-4a00-9516-648ec388985e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:04.540254 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744875f4-6354-4a00-9516-648ec388985e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:04.541863 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744875f4-6354-4a00-9516-648ec388985e service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:04.549910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1454/2898] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:25:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:25:04.863694 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11225-805f-4453-84df-7db79db17a3c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:04.863980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11225-805f-4453-84df-7db79db17a3c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:04.864249 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11225-805f-4453-84df-7db79db17a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:04.883753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fcd11225-805f-4453-84df-7db79db17a3c None None] MFA Rules not processed for user `912d86eef7b64c0a8b260ae7a804991d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:04.884947 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fcd11225-805f-4453-84df-7db79db17a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:04.892486 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1445/2899] 10.222.0.20 () {58 vars in 967 bytes} [Thu Sep 8 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:04.905646 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744875f4-6354-4a00-9516-648ec388985e service swift] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:04.916183 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744875f4-6354-4a00-9516-648ec388985e service swift] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:04.921239 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755c1a5-3b23-4d1d-ad69-82645e01ff51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c3d9f448692440fbeee652da473fd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:04.921872 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755c1a5-3b23-4d1d-ad69-82645e01ff51 service swift] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:04.922158 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755c1a5-3b23-4d1d-ad69-82645e01ff51 service swift] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:04.922461 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755c1a5-3b23-4d1d-ad69-82645e01ff51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:04.930495 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755c1a5-3b23-4d1d-ad69-82645e01ff51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:04.932056 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755c1a5-3b23-4d1d-ad69-82645e01ff51 service swift] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:04.940041 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1455/2900] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Sep 8 01:25:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 01:25:06.990207 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd11225-805f-4453-84df-7db79db17a3c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.053178 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd11225-805f-4453-84df-7db79db17a3c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.057726 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.058348 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.058628 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.058900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] PATH_INFO: `/v3/users/ada09d6f9b7142d982fdb04cc15aa9d1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.060043 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada09d6f9b7142d982fdb04cc15aa9d1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.062671 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:07.107109 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada09d6f9b7142d982fdb04cc15aa9d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.115033 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada09d6f9b7142d982fdb04cc15aa9d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.116147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:07.130953 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada09d6f9b7142d982fdb04cc15aa9d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.131595 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada09d6f9b7142d982fdb04cc15aa9d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.138338 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada09d6f9b7142d982fdb04cc15aa9d1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.144055 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1446/2901] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:25:06 2022] DELETE /identity/v3/users/ada09d6f9b7142d982fdb04cc15aa9d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 01:25:07.148525 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d778f-4481-4322-a22b-f5abd16bd792 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.149039 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d778f-4481-4322-a22b-f5abd16bd792 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.149152 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d778f-4481-4322-a22b-f5abd16bd792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.167667 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-8b6d778f-4481-4322-a22b-f5abd16bd792 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:07.168810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8b6d778f-4481-4322-a22b-f5abd16bd792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:07.226910 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1456/2902] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:07.236980 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.238477 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:07.294357 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e3d41-d69b-46db-8ae2-01d3869f812f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.298463 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7b088-5495-4554-8e63-7e808eaefec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.299053 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7b088-5495-4554-8e63-7e808eaefec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.299328 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7b088-5495-4554-8e63-7e808eaefec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.299593 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7b088-5495-4554-8e63-7e808eaefec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.308473 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7b088-5495-4554-8e63-7e808eaefec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.309930 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7b088-5495-4554-8e63-7e808eaefec9 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:07.318970 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1447/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:07.481469 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d778f-4481-4322-a22b-f5abd16bd792 None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.483472 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-8b6d778f-4481-4322-a22b-f5abd16bd792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:07.498997 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d778f-4481-4322-a22b-f5abd16bd792 None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.508150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.508150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.508150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.508150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] PATH_INFO: `/v3/projects/3b0df56a24e74553aa79fed362d40180` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.509044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0df56a24e74553aa79fed362d40180)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.509044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:07.539378 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:07.556986 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0df56a24e74553aa79fed362d40180', 'request_id': 'req-33708472-a092-4a5c-a540-1b65a1d3bde3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.564267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0df56a24e74553aa79fed362d40180', 'request_id': 'req-33708472-a092-4a5c-a540-1b65a1d3bde3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.569883 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0df56a24e74553aa79fed362d40180', 'request_id': 'req-33708472-a092-4a5c-a540-1b65a1d3bde3'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.580704 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] The token cache is being invalidate because project 3b0df56a24e74553aa79fed362d40180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:25:07.580994 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.581660 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-33708472-a092-4a5c-a540-1b65a1d3bde3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:25:07.583295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1457/2904] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:25:07 2022] DELETE /identity/v3/projects/3b0df56a24e74553aa79fed362d40180 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:25:07.588072 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177c6a3-cb96-4c84-9f94-8ea6334492af None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.588368 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177c6a3-cb96-4c84-9f94-8ea6334492af None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.588644 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177c6a3-cb96-4c84-9f94-8ea6334492af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.609000 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2177c6a3-cb96-4c84-9f94-8ea6334492af None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:07.610223 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2177c6a3-cb96-4c84-9f94-8ea6334492af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:07.669341 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1448/2905] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:07.677012 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909800a8-c681-43ea-84e3-83c5bbb990ff None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.677300 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909800a8-c681-43ea-84e3-83c5bbb990ff None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.677610 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909800a8-c681-43ea-84e3-83c5bbb990ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.697054 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-909800a8-c681-43ea-84e3-83c5bbb990ff None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:07.698230 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-909800a8-c681-43ea-84e3-83c5bbb990ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:07.706695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1458/2906] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:07.710705 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177c6a3-cb96-4c84-9f94-8ea6334492af None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.720790 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177c6a3-cb96-4c84-9f94-8ea6334492af None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.725663 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.726262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.726543 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.726815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.727455 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 01:25:07.727752 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.729334 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:07.740819 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1449/2907] 10.222.0.20 () {58 vars in 1153 bytes} [Thu Sep 8 01:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 01:25:07.744942 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909800a8-c681-43ea-84e3-83c5bbb990ff None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.754497 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909800a8-c681-43ea-84e3-83c5bbb990ff None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.759148 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6f7f-1302-4dae-ab0c-3acc9d1b8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.759737 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6f7f-1302-4dae-ab0c-3acc9d1b8073 admin admin] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.760017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6f7f-1302-4dae-ab0c-3acc9d1b8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.760290 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6f7f-1302-4dae-ab0c-3acc9d1b8073 admin admin] PATH_INFO: `/v3/projects` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.760924 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e6f7f-1302-4dae-ab0c-3acc9d1b8073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.762857 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e6f7f-1302-4dae-ab0c-3acc9d1b8073 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:07.791265 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1459/2908] 10.222.0.20 () {60 vars in 1153 bytes} [Thu Sep 8 01:25:07 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 01:25:07.796815 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.806926 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b881f9-85cb-45bf-9da0-ee86202c9891 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.862601 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee40593-2837-429b-b52e-9e24a0143af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.863191 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee40593-2837-429b-b52e-9e24a0143af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.863468 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee40593-2837-429b-b52e-9e24a0143af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.863735 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee40593-2837-429b-b52e-9e24a0143af6 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.864346 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee40593-2837-429b-b52e-9e24a0143af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.866409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee40593-2837-429b-b52e-9e24a0143af6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:07.875110 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:07.889686 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1450/2909] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Sep 8 01:25:07 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 01:25:07.893696 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6f7f-1302-4dae-ab0c-3acc9d1b8073 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.904037 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6f7f-1302-4dae-ab0c-3acc9d1b8073 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.909253 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173b97-4e37-44b8-909a-70a4e002284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.909892 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173b97-4e37-44b8-909a-70a4e002284f admin admin] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.910176 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173b97-4e37-44b8-909a-70a4e002284f admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.910452 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6173b97-4e37-44b8-909a-70a4e002284f admin admin] PATH_INFO: `/v3/roles` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.911095 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173b97-4e37-44b8-909a-70a4e002284f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.912687 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6173b97-4e37-44b8-909a-70a4e002284f admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:07.922606 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1460/2910] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:25:07.926584 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee40593-2837-429b-b52e-9e24a0143af6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.936317 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee40593-2837-429b-b52e-9e24a0143af6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.940864 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cda89-86b6-45aa-ba85-75473e712461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.941471 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cda89-86b6-45aa-ba85-75473e712461 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.941753 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cda89-86b6-45aa-ba85-75473e712461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.942020 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cda89-86b6-45aa-ba85-75473e712461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.942703 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cda89-86b6-45aa-ba85-75473e712461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.944283 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cda89-86b6-45aa-ba85-75473e712461 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:07.955148 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1451/2911] 10.222.0.20 () {58 vars in 1122 bytes} [Thu Sep 8 01:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 01:25:07.958917 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173b97-4e37-44b8-909a-70a4e002284f admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:07.968876 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6173b97-4e37-44b8-909a-70a4e002284f admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:07.973556 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:07.974193 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:07.974470 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:07.974742 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] PATH_INFO: `/v3/projects/5b99419926964b5680cd24fcebfaf5a4/users/fdb4ee7fadd2473c86367973f76da858/roles/193a2ccbf16642a0af3edc128493946e` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:07.989843 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b99419926964b5680cd24fcebfaf5a4, user_id=fdb4ee7fadd2473c86367973f76da858, role_id=193a2ccbf16642a0af3edc128493946e)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:07.992719 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:08.006338 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1461/2912] 10.222.0.20 () {60 vars in 1483 bytes} [Thu Sep 8 01:25:07 2022] PUT /identity/v3/projects/5b99419926964b5680cd24fcebfaf5a4/users/fdb4ee7fadd2473c86367973f76da858/roles/193a2ccbf16642a0af3edc128493946e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:25:08.011290 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa995f8b-dbf3-4d06-9edd-cccc1c3546ed None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:08.011780 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa995f8b-dbf3-4d06-9edd-cccc1c3546ed None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:08.011880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa995f8b-dbf3-4d06-9edd-cccc1c3546ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:08.030907 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-aa995f8b-dbf3-4d06-9edd-cccc1c3546ed None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:08.032089 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aa995f8b-dbf3-4d06-9edd-cccc1c3546ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:08.092838 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1452/2913] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:08.102501 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:08.104363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:08.161535 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d85e7-5a47-4b4c-9156-64a4aea9b246 admin admin] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:08.165306 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:08.165928 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:08.166205 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:08.166474 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:08.175422 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:08.176881 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:08.186793 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1462/2914] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:08.802068 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c022d-587b-4836-a6a5-41a95808014a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:08.802361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c022d-587b-4836-a6a5-41a95808014a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:08.802641 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c022d-587b-4836-a6a5-41a95808014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:08.832039 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5c5c022d-587b-4836-a6a5-41a95808014a None None] MFA Rules not processed for user `fdb4ee7fadd2473c86367973f76da858`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:08.833262 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5c5c022d-587b-4836-a6a5-41a95808014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:08.902921 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1453/2915] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:08.918352 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:08.920444 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:08.979359 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716731-4f30-4c9f-b395-58a902ae377c service neutron] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:08.983575 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18001cf-c1db-481a-ac76-005516173cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274ba5fef7d24d97ac97c33a68bb6aec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:08.984175 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18001cf-c1db-481a-ac76-005516173cdc service cinder] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:08.984453 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18001cf-c1db-481a-ac76-005516173cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:08.984723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18001cf-c1db-481a-ac76-005516173cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:08.991063 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:08.993330 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18001cf-c1db-481a-ac76-005516173cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:08.995579 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18001cf-c1db-481a-ac76-005516173cdc service cinder] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:09.005309 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1463/2916] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:10.362633 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12955-5c76-4f88-9ba0-79f25f8a746e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:10.363116 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12955-5c76-4f88-9ba0-79f25f8a746e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:10.363243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12955-5c76-4f88-9ba0-79f25f8a746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:10.382141 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-92d12955-5c76-4f88-9ba0-79f25f8a746e None None] MFA Rules not processed for user `fdb4ee7fadd2473c86367973f76da858`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:10.383339 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-92d12955-5c76-4f88-9ba0-79f25f8a746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:10.390378 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1454/2917] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:10.618875 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18001cf-c1db-481a-ac76-005516173cdc service cinder] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:10.628656 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18001cf-c1db-481a-ac76-005516173cdc service cinder] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:10.632336 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe8d5-dec6-4cf7-a83c-311c0175188e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6ff1b9371a411bae7b3e45f78e05e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:10.632954 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe8d5-dec6-4cf7-a83c-311c0175188e service neutron] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:10.633236 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe8d5-dec6-4cf7-a83c-311c0175188e service neutron] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:10.633545 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe8d5-dec6-4cf7-a83c-311c0175188e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:10.635251 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-956fe8d5-dec6-4cf7-a83c-311c0175188e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:10.645147 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe8d5-dec6-4cf7-a83c-311c0175188e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:10.646595 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe8d5-dec6-4cf7-a83c-311c0175188e service neutron] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:10.655161 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1464/2918] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:17.984038 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12955-5c76-4f88-9ba0-79f25f8a746e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:17.985544 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-92d12955-5c76-4f88-9ba0-79f25f8a746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:18.055579 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:18.063443 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12955-5c76-4f88-9ba0-79f25f8a746e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:18.069263 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:18.069903 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:18.070208 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:18.070480 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:18.072195 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:18.085732 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:18.087243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:18.098614 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1455/2919] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:20.650907 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=8 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:28.093862 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:25:36.615608 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9084d-ecdf-4c17-acd1-89ac972c8c39 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:36.616046 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9084d-ecdf-4c17-acd1-89ac972c8c39 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:36.616260 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9084d-ecdf-4c17-acd1-89ac972c8c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:36.636438 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-3de9084d-ecdf-4c17-acd1-89ac972c8c39 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:36.637709 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-3de9084d-ecdf-4c17-acd1-89ac972c8c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:36.646418 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1465/2920] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:36.672900 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:36.674570 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:36.689196 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b4c2-96c7-484b-b6ca-59b0fcbcdf59 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:36.694949 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c60ef4-224d-46c5-bcf1-2c5ff4490c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:36.695551 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c60ef4-224d-46c5-bcf1-2c5ff4490c0a service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:36.695832 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c60ef4-224d-46c5-bcf1-2c5ff4490c0a service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:36.696106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c60ef4-224d-46c5-bcf1-2c5ff4490c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:36.704426 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c60ef4-224d-46c5-bcf1-2c5ff4490c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:36.706045 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c60ef4-224d-46c5-bcf1-2c5ff4490c0a service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:36.715522 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1456/2921] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:39.663440 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef848b-5d1e-47b4-adac-ef7854e1c82f None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:39.664004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef848b-5d1e-47b4-adac-ef7854e1c82f None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:39.664004 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef848b-5d1e-47b4-adac-ef7854e1c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:39.683116 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f3ef848b-5d1e-47b4-adac-ef7854e1c82f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:39.684343 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f3ef848b-5d1e-47b4-adac-ef7854e1c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:39.692358 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1466/2922] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:39.713147 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c60ef4-224d-46c5-bcf1-2c5ff4490c0a service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:39.724857 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c60ef4-224d-46c5-bcf1-2c5ff4490c0a service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:39.730288 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bb95-c21b-40af-95b1-22771bb4483e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:39.730874 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bb95-c21b-40af-95b1-22771bb4483e service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:39.731157 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bb95-c21b-40af-95b1-22771bb4483e service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:39.731427 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bb95-c21b-40af-95b1-22771bb4483e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:39.739419 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3bb95-c21b-40af-95b1-22771bb4483e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:39.740975 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3bb95-c21b-40af-95b1-22771bb4483e service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:39.750209 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1457/2923] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:42.927194 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5674-9816-4647-a25f-cf2939a6f6b0 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:42.927756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5674-9816-4647-a25f-cf2939a6f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:42.927756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5674-9816-4647-a25f-cf2939a6f6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:42.946914 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-626a5674-9816-4647-a25f-cf2939a6f6b0 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:42.948113 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-626a5674-9816-4647-a25f-cf2939a6f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:42.956017 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1467/2924] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:42.977181 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bb95-c21b-40af-95b1-22771bb4483e service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:42.989187 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bb95-c21b-40af-95b1-22771bb4483e service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:42.994861 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ffcf-95ea-4eb9-9dda-465581a9ed22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:42.995447 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ffcf-95ea-4eb9-9dda-465581a9ed22 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:42.995728 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ffcf-95ea-4eb9-9dda-465581a9ed22 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:42.996027 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ffcf-95ea-4eb9-9dda-465581a9ed22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:43.004513 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ffcf-95ea-4eb9-9dda-465581a9ed22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:43.006113 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ffcf-95ea-4eb9-9dda-465581a9ed22 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:43.015406 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1458/2925] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:46.009605 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1cfbf-754b-4b8a-93ff-2859c1d12f13 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:46.010089 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1cfbf-754b-4b8a-93ff-2859c1d12f13 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:46.010209 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1cfbf-754b-4b8a-93ff-2859c1d12f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:46.029552 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-4cc1cfbf-754b-4b8a-93ff-2859c1d12f13 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:46.030747 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-4cc1cfbf-754b-4b8a-93ff-2859c1d12f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:46.039060 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1468/2926] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:46.060739 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ffcf-95ea-4eb9-9dda-465581a9ed22 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:46.072016 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ffcf-95ea-4eb9-9dda-465581a9ed22 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:46.077502 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46836547-aabb-47df-bc33-2563c2dd2c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:46.078085 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46836547-aabb-47df-bc33-2563c2dd2c64 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:46.078361 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46836547-aabb-47df-bc33-2563c2dd2c64 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:46.078649 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46836547-aabb-47df-bc33-2563c2dd2c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:46.086829 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46836547-aabb-47df-bc33-2563c2dd2c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:46.088388 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46836547-aabb-47df-bc33-2563c2dd2c64 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:46.098144 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1459/2927] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:49.168326 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014840-7a36-48b7-820e-c672495c5e16 None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:49.168838 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014840-7a36-48b7-820e-c672495c5e16 None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:49.168945 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014840-7a36-48b7-820e-c672495c5e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:49.188463 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-ae014840-7a36-48b7-820e-c672495c5e16 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:49.189666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-ae014840-7a36-48b7-820e-c672495c5e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:49.197275 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1469/2928] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:49.221054 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46836547-aabb-47df-bc33-2563c2dd2c64 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:49.232775 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46836547-aabb-47df-bc33-2563c2dd2c64 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:49.238226 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec54b4-95b7-40a3-8079-0db5d43aa242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:49.238806 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec54b4-95b7-40a3-8079-0db5d43aa242 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:49.239091 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec54b4-95b7-40a3-8079-0db5d43aa242 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:49.239362 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec54b4-95b7-40a3-8079-0db5d43aa242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:49.247319 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec54b4-95b7-40a3-8079-0db5d43aa242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:49.248879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec54b4-95b7-40a3-8079-0db5d43aa242 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:49.258409 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1460/2929] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:25:52.324068 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082eac1-e13b-459d-971f-1f32f1864dcb None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:52.324564 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082eac1-e13b-459d-971f-1f32f1864dcb None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:52.324695 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082eac1-e13b-459d-971f-1f32f1864dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:52.344099 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-f082eac1-e13b-459d-971f-1f32f1864dcb None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:25:52.345295 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-f082eac1-e13b-459d-971f-1f32f1864dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:25:52.354363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1470/2930] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:25:52.377260 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec54b4-95b7-40a3-8079-0db5d43aa242 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:25:52.388254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec54b4-95b7-40a3-8079-0db5d43aa242 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:25:52.393658 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ee4f5-947b-4881-bf0e-4181ad479401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:25:52.394243 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ee4f5-947b-4881-bf0e-4181ad479401 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:25:52.395022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ee4f5-947b-4881-bf0e-4181ad479401 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:25:52.395293 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ee4f5-947b-4881-bf0e-4181ad479401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:25:52.403238 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ee4f5-947b-4881-bf0e-4181ad479401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:25:52.404792 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ee4f5-947b-4881-bf0e-4181ad479401 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:25:52.414687 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1461/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:26:02.339319 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=18 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:26:02.409847 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=36 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:26:07.406786 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78b8ac-b131-4135-812a-c04ee1c9c74d None None] REQUEST_METHOD: `POST` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:07.407321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78b8ac-b131-4135-812a-c04ee1c9c74d None None] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:07.407321 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78b8ac-b131-4135-812a-c04ee1c9c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:07.425959 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.auth.core [None req-2a78b8ac-b131-4135-812a-c04ee1c9c74d None None] MFA Rules not processed for user `fdb4ee7fadd2473c86367973f76da858`. Rule list: `[]` (Enabled: `True`). {{(pid=81675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:26:07.427157 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.fernet_utils [None req-2a78b8ac-b131-4135-812a-c04ee1c9c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:26:07.434436 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1471/2932] 10.222.0.20 () {58 vars in 958 bytes} [Thu Sep 8 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:26:17.421150 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=3 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:26:17.992051 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8b0d-78da-4167-93a3-77abec32dcb7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:17.992611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8b0d-78da-4167-93a3-77abec32dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:17.992611 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8b0d-78da-4167-93a3-77abec32dcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:18.013666 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9c4a8b0d-78da-4167-93a3-77abec32dcb7 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:26:18.014880 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9c4a8b0d-78da-4167-93a3-77abec32dcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:26:18.023219 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1462/2933] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:26:18.043993 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78b8ac-b131-4135-812a-c04ee1c9c74d None None] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:26:18.056706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78b8ac-b131-4135-812a-c04ee1c9c74d None None] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:26:18.062106 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff2cba-fceb-4ec2-9bfc-0f1c54e98e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:26:18.062701 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff2cba-fceb-4ec2-9bfc-0f1c54e98e7e service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:18.062981 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff2cba-fceb-4ec2-9bfc-0f1c54e98e7e service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:18.063255 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff2cba-fceb-4ec2-9bfc-0f1c54e98e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:18.071759 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff2cba-fceb-4ec2-9bfc-0f1c54e98e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:26:18.073316 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff2cba-fceb-4ec2-9bfc-0f1c54e98e7e service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:26:18.082582 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1472/2934] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:26:21.236292 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa4ce-03ad-4f7d-9fc0-9e45d587665f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:21.236824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa4ce-03ad-4f7d-9fc0-9e45d587665f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:21.236824 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafa4ce-03ad-4f7d-9fc0-9e45d587665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:21.256168 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1dafa4ce-03ad-4f7d-9fc0-9e45d587665f None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:26:21.257951 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1dafa4ce-03ad-4f7d-9fc0-9e45d587665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:26:21.265754 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1463/2935] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:26:21.286782 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff2cba-fceb-4ec2-9bfc-0f1c54e98e7e service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:26:21.298279 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff2cba-fceb-4ec2-9bfc-0f1c54e98e7e service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:26:21.303720 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553195b-aedb-4e6f-aace-07cb7b8a71e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:26:21.304801 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553195b-aedb-4e6f-aace-07cb7b8a71e2 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:21.305080 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553195b-aedb-4e6f-aace-07cb7b8a71e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:21.305349 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553195b-aedb-4e6f-aace-07cb7b8a71e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:21.313666 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553195b-aedb-4e6f-aace-07cb7b8a71e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:26:21.315269 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553195b-aedb-4e6f-aace-07cb7b8a71e2 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:26:21.325406 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1473/2936] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:26:24.328429 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b7497-8bcf-4b32-bdd5-c05e3ccce37a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:24.328945 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b7497-8bcf-4b32-bdd5-c05e3ccce37a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:24.329064 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b7497-8bcf-4b32-bdd5-c05e3ccce37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:24.348594 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e69b7497-8bcf-4b32-bdd5-c05e3ccce37a None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:26:24.349807 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e69b7497-8bcf-4b32-bdd5-c05e3ccce37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:26:24.358204 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1464/2937] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:26:24.378904 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553195b-aedb-4e6f-aace-07cb7b8a71e2 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:26:24.389984 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553195b-aedb-4e6f-aace-07cb7b8a71e2 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:26:24.395363 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fe5cb-8968-4ec6-8283-f95c8047a672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:26:24.395988 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe5cb-8968-4ec6-8283-f95c8047a672 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:24.396267 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe5cb-8968-4ec6-8283-f95c8047a672 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:24.396538 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fe5cb-8968-4ec6-8283-f95c8047a672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:24.404896 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fe5cb-8968-4ec6-8283-f95c8047a672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:26:24.406478 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fe5cb-8968-4ec6-8283-f95c8047a672 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:26:24.416211 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1474/2938] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:26:27.486182 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16d04-6afe-4f0e-a296-aa38987662e2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:27.486678 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16d04-6afe-4f0e-a296-aa38987662e2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:27.486781 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16d04-6afe-4f0e-a296-aa38987662e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:27.506106 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-dcb16d04-6afe-4f0e-a296-aa38987662e2 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:26:27.507308 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dcb16d04-6afe-4f0e-a296-aa38987662e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:26:27.515177 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1465/2939] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:26:27.540798 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fe5cb-8968-4ec6-8283-f95c8047a672 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:26:27.552023 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fe5cb-8968-4ec6-8283-f95c8047a672 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:26:27.557520 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69938de9-3184-404e-8a02-907fedd7f4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:26:27.558119 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69938de9-3184-404e-8a02-907fedd7f4ca service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:27.558397 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69938de9-3184-404e-8a02-907fedd7f4ca service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:27.558670 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69938de9-3184-404e-8a02-907fedd7f4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:27.566635 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69938de9-3184-404e-8a02-907fedd7f4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:26:27.568197 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69938de9-3184-404e-8a02-907fedd7f4ca service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:26:27.577630 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1475/2940] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:26:30.651224 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f96915-7672-4a7c-983e-ea6fca6ac816 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:30.651646 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f96915-7672-4a7c-983e-ea6fca6ac816 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:30.651777 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f96915-7672-4a7c-983e-ea6fca6ac816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:30.670901 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-60f96915-7672-4a7c-983e-ea6fca6ac816 None None] MFA Rules not processed for user `802225de4e5b4f0395304da25f9b41c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 01:26:30.672093 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-60f96915-7672-4a7c-983e-ea6fca6ac816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:26:30.679895 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1466/2941] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 01:26:30.707479 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69938de9-3184-404e-8a02-907fedd7f4ca service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:26:30.719533 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69938de9-3184-404e-8a02-907fedd7f4ca service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:26:30.724876 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e63ed-0c18-4354-a808-11ab04812bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b9f7c644bde4c94a8cfe5ec13e782c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:26:30.725494 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e63ed-0c18-4354-a808-11ab04812bd2 service nova] REQUEST_METHOD: `GET` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:30.725776 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e63ed-0c18-4354-a808-11ab04812bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:30.726047 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e63ed-0c18-4354-a808-11ab04812bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:30.734044 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e63ed-0c18-4354-a808-11ab04812bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:26:30.735604 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e63ed-0c18-4354-a808-11ab04812bd2 service nova] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:26:30.744780 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1476/2942] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:26:40.665647 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=15 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:26:40.740756 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=30 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:26:58.786428 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f96915-7672-4a7c-983e-ea6fca6ac816 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:26:58.797120 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f96915-7672-4a7c-983e-ea6fca6ac816 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:26:58.801725 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:26:58.802360 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:58.802638 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:58.802911 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] PATH_INFO: `/v3/users/fdb4ee7fadd2473c86367973f76da858` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:58.804022 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb4ee7fadd2473c86367973f76da858)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:26:58.805965 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:26:58.850548 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb4ee7fadd2473c86367973f76da858'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:58.858560 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb4ee7fadd2473c86367973f76da858'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:58.870254 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb4ee7fadd2473c86367973f76da858'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:58.870886 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb4ee7fadd2473c86367973f76da858'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:58.878920 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb4ee7fadd2473c86367973f76da858'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:58.884653 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1467/2943] 10.222.0.20 () {58 vars in 1224 bytes} [Thu Sep 8 01:26:58 2022] DELETE /identity/v3/users/fdb4ee7fadd2473c86367973f76da858 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:26:59.052810 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e63ed-0c18-4354-a808-11ab04812bd2 service nova] Authenticating user token {{(pid=81675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:26:59.063428 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e63ed-0c18-4354-a808-11ab04812bd2 service nova] Validating token access rules against request {{(pid=81675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:26:59.123200 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '802225de4e5b4f0395304da25f9b41c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a2335b6b0e4e3b94d114442755e8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:26:59.123822 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:26:59.124098 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:26:59.124368 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] PATH_INFO: `/v3/projects/5b99419926964b5680cd24fcebfaf5a4` {{(pid=81675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:26:59.125496 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b99419926964b5680cd24fcebfaf5a4)` {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:26:59.127637 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] RBAC: Authorization granted {{(pid=81675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:26:59.173557 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b99419926964b5680cd24fcebfaf5a4', 'request_id': 'req-1a981bed-94c5-4fb6-b571-269edc4d76f2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:59.180723 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b99419926964b5680cd24fcebfaf5a4', 'request_id': 'req-1a981bed-94c5-4fb6-b571-269edc4d76f2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:59.186853 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b99419926964b5680cd24fcebfaf5a4', 'request_id': 'req-1a981bed-94c5-4fb6-b571-269edc4d76f2'} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:59.197657 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] The token cache is being invalidate because project 5b99419926964b5680cd24fcebfaf5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 01:26:59.197970 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:59.198596 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG keystone.notifications [None req-1a981bed-94c5-4fb6-b571-269edc4d76f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 01:26:59.200064 dv-cinder-847733-3-smb devstack@keystone.service[81675]: [pid: 81675|app: 0|req: 1477/2944] 10.222.0.20 () {58 vars in 1233 bytes} [Thu Sep 8 01:26:59 2022] DELETE /identity/v3/projects/5b99419926964b5680cd24fcebfaf5a4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 01:27:08.881251 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:27:09.194706 dv-cinder-847733-3-smb devstack@keystone.service[81675]: DEBUG dbcounter [-] [81675] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:27:44.426489 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 01:27:44.427879 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:27:44.494987 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3f0e5-d43c-4a9b-8b2d-d03af976fbb8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 01:27:44.552848 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd6bf7-1fd8-46a8-8d00-3fe2c22d4706 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e636a8e4704971ae840035f3fc4e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454105f786874ed1b407da41aef24389', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 01:27:44.553482 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd6bf7-1fd8-46a8-8d00-3fe2c22d4706 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 01:27:44.553764 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd6bf7-1fd8-46a8-8d00-3fe2c22d4706 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 01:27:44.554034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd6bf7-1fd8-46a8-8d00-3fe2c22d4706 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 01:27:44.555746 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-05fd6bf7-1fd8-46a8-8d00-3fe2c22d4706 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 01:27:44.567456 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd6bf7-1fd8-46a8-8d00-3fe2c22d4706 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 01:27:44.569034 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd6bf7-1fd8-46a8-8d00-3fe2c22d4706 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 01:27:44.578937 dv-cinder-847733-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1468/2945] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Sep 8 01:27:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 01:27:54.574701 dv-cinder-847733-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=58 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}